[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:53 dist-test-slave-7vjv krb5kdc[8801](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:53 dist-test-slave-7vjv krb5kdc[8801](info): set up 2 sockets
Aug 08 08:46:53 dist-test-slave-7vjv krb5kdc[8801](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 08:46:55.184808 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:46:55 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:46:55.364017 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:43863
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:43863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:55.730125 8824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:55.730522 8824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:55.730687 8824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:55.737932 8824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:55.738063 8824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:55.738173 8824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:55.738267 8824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:55.738349 8824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:55.748773 8824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:43863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:43863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:55.750595 8824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:55.752482 8824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:55.772248 8832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:55.772042 8838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:55.772281 8833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:55.773574 8824 server_base.cc:1034] running on GCE node
I20260808 08:46:55.774696 8824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:55.776747 8824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:55.778033 8824 hybrid_clock.cc:648] HybridClock initialized: now 1786178815777923 us; error 101 us; skew 500 ppm
I20260808 08:46:55.778615 8824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:55 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178815, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:55.782416 8824 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:46:55.784994 8824 webserver.cc:460] Webserver started at http://127.8.149.126:34351/ using document root <none> and password file <none>
I20260808 08:46:55.786078 8824 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:55.786196 8824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:55.786619 8824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:55.790572 8824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "d55e910cfb2b41ba9e84422dc3890738"
format_stamp: "Formatted at 2026-08-08 08:46:55 on dist-test-slave-7vjv"
server_key: "beba408272a940e58daffdcdcd87bc9d"
server_key_iv: "0d9224c87b041e6402ce2e3cb68e4f9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:55.791291 8824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "d55e910cfb2b41ba9e84422dc3890738"
format_stamp: "Formatted at 2026-08-08 08:46:55 on dist-test-slave-7vjv"
server_key: "beba408272a940e58daffdcdcd87bc9d"
server_key_iv: "0d9224c87b041e6402ce2e3cb68e4f9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:55.799119 8824 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 08:46:55.804416 8852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:55.806344 8824 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:46:55.806635 8824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "d55e910cfb2b41ba9e84422dc3890738"
format_stamp: "Formatted at 2026-08-08 08:46:55 on dist-test-slave-7vjv"
server_key: "beba408272a940e58daffdcdcd87bc9d"
server_key_iv: "0d9224c87b041e6402ce2e3cb68e4f9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:55.806973 8824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:55.825156 8824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:55.829869 8824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:55.830267 8824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:55.853786 8824 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:43863
I20260808 08:46:55.853868 8954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:43863 every 8 connection(s)
I20260808 08:46:55.856003 8824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:55.859157 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 8824
I20260808 08:46:55.859508 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:46:55.861738 8789 external_mini_cluster.cc:1428] Setting key 94906aa858836acfa785d7e7e7ad96b7
I20260808 08:46:55.862576 8955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:55.879510 8955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: Bootstrap starting.
I20260808 08:46:55.884620 8955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:55.886107 8955 log.cc:824] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:55.889815 8955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: No bootstrap required, opened a new log
Aug 08 08:46:55 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:46:55.899636 8955 raft_consensus.cc:348] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } }
I20260808 08:46:55.900169 8955 raft_consensus.cc:374] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:55.900408 8955 raft_consensus.cc:729] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55e910cfb2b41ba9e84422dc3890738, State: Initialized, Role: FOLLOWER
I20260808 08:46:55.901715 8955 consensus_queue.cc:260] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } }
I20260808 08:46:55.902200 8955 raft_consensus.cc:388] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:55.902536 8955 raft_consensus.cc:482] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:55.902853 8955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:55.905977 8958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:55.867767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55726 (local address 127.8.149.126:43863)
0808 08:46:55.869113 (+ 1346us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:55.869137 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:55.870447 (+ 1310us) server_negotiation.cc:407] Connection header received
0808 08:46:55.880587 (+ 10140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:55.880606 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:55.881105 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:55.881524 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:55.884870 (+ 3346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:55.886318 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:55.888525 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:55.889250 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:55.889531 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:55.895774 (+ 6243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:55.895827 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:55.895883 (+ 56us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:55.895939 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:55.899263 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:55.900185 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:55.900191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:55.900196 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:55.900461 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:55.901027 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:55.901032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:55.901036 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:55.902166 (+ 1130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:55.902753 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:55.903565 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 08:46:55.904030 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":925,"thread_start_us":593,"threads_started":1}
I20260808 08:46:55.906791 8955 raft_consensus.cc:504] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } }
I20260808 08:46:55.908144 8955 leader_election.cc:302] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d55e910cfb2b41ba9e84422dc3890738; no voters:
I20260808 08:46:55.909102 8955 leader_election.cc:288] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:55.909417 8964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:55.912197 8964 raft_consensus.cc:686] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [term 1 LEADER]: Becoming Leader. State: Replica: d55e910cfb2b41ba9e84422dc3890738, State: Running, Role: LEADER
I20260808 08:46:55.912598 8955 sys_catalog.cc:564] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:55.913213 8964 consensus_queue.cc:237] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } }
I20260808 08:46:55.918900 8965 sys_catalog.cc:455] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d55e910cfb2b41ba9e84422dc3890738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } } }
I20260808 08:46:55.918962 8967 sys_catalog.cc:455] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d55e910cfb2b41ba9e84422dc3890738. Latest consensus state: current_term: 1 leader_uuid: "d55e910cfb2b41ba9e84422dc3890738" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d55e910cfb2b41ba9e84422dc3890738" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43863 } } }
I20260808 08:46:55.919531 8967 sys_catalog.cc:458] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:55.919561 8965 sys_catalog.cc:458] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738 [sys.catalog]: This master's current role is: LEADER
W20260808 08:46:55.931624 8992 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:46:55.931780 8992 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:46:55.931916 8986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:55.934414 8986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:55.947801 8986 catalog_manager.cc:1347] Generated new cluster ID: bf38b9b2963b435c8effceaad5093e11
I20260808 08:46:55.947906 8986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:55.979913 8986 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:55.981514 8986 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:55.988652 8986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d55e910cfb2b41ba9e84422dc3890738: Generated new TSK 0
I20260808 08:46:55.989601 8986 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:46:56.048063 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:56.460835 9003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:56.461158 9003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:56.461336 9003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:56.468935 9003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:56.469086 9003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:56.469304 9003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:46:56.480027 9003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:56.481431 9003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:56.482995 9003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:56.499554 9010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:56.499537 9013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:56.500501 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:56.501540 9003 server_base.cc:1034] running on GCE node
I20260808 08:46:56.502334 9003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:56.503722 9003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:56.505062 9003 hybrid_clock.cc:648] HybridClock initialized: now 1786178816505010 us; error 132 us; skew 500 ppm
I20260808 08:46:56.505478 9003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:56 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:56.509563 9003 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:46:56.511318 9003 webserver.cc:460] Webserver started at http://127.8.149.65:40997/ using document root <none> and password file <none>
I20260808 08:46:56.512017 9003 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:56.512255 9003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:56.512676 9003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:56.516215 9003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "450e4cc8f142485e8d26e1fec901999d"
format_stamp: "Formatted at 2026-08-08 08:46:56 on dist-test-slave-7vjv"
server_key: "805989e5db9a7c2319cfa8e19ca3399b"
server_key_iv: "f0ca04f6ffc5e97f8d6f0aef8472a305"
server_key_version: "encryptionkey@0"
I20260808 08:46:56.517179 9003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "450e4cc8f142485e8d26e1fec901999d"
format_stamp: "Formatted at 2026-08-08 08:46:56 on dist-test-slave-7vjv"
server_key: "805989e5db9a7c2319cfa8e19ca3399b"
server_key_iv: "f0ca04f6ffc5e97f8d6f0aef8472a305"
server_key_version: "encryptionkey@0"
I20260808 08:46:56.523208 9003 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:46:56.527726 9031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:56.529034 9003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:56.529217 9003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "450e4cc8f142485e8d26e1fec901999d"
format_stamp: "Formatted at 2026-08-08 08:46:56 on dist-test-slave-7vjv"
server_key: "805989e5db9a7c2319cfa8e19ca3399b"
server_key_iv: "f0ca04f6ffc5e97f8d6f0aef8472a305"
server_key_version: "encryptionkey@0"
I20260808 08:46:56.529492 9003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:56.544885 9003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:56.550172 9003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:56.550593 9003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:56.551985 9003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:46:56.553813 9003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:46:56.553987 9003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:56.554242 9003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:46:56.554355 9003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:56.596567 9003 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:42195
I20260808 08:46:56.596725 9224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:42195 every 8 connection(s)
I20260808 08:46:56.598294 9003 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:46:56.608080 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9003
I20260808 08:46:56.608403 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:46:56.609191 8789 external_mini_cluster.cc:1428] Setting key aa73a3cff1b0560933e582cbb68913b1
Aug 08 08:46:56 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178816, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:46:56.623135 9229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:56.601851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:34209 (local address 127.8.149.126:43863)
0808 08:46:56.602663 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:56.602671 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:56.603429 (+ 758us) server_negotiation.cc:407] Connection header received
0808 08:46:56.605905 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:56.605912 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:56.605994 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:56.606106 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:56.608093 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:56.609128 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:56.611320 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:56.611864 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:56.611994 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:56.616591 (+ 4597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:56.616597 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:56.616600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:56.616631 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:56.619905 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:56.620697 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:56.620703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:56.620706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:56.620820 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:56.621244 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:56.621248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:56.621251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:56.621493 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:56.621661 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:56.622403 (+ 742us) server_negotiation.cc:299] Negotiation successful
0808 08:46:56.622632 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":518,"threads_started":1}
I20260808 08:46:56.624351 9230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:56.602320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43863 (local address 127.8.149.65:34209)
0808 08:46:56.603259 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:56.603321 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:56.605643 (+ 2322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:56.606400 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:56.606408 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:56.607063 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:56.607885 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:56.607904 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:56.609320 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:56.609324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:56.611159 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:56.611171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:56.612232 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:56.612242 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:56.612616 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:56.613448 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:56.613490 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:56.616321 (+ 2831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:56.620043 (+ 3722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:56.620050 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:56.620062 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:56.620568 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:56.620933 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:56.620938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:56.620941 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:56.621134 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:56.621646 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:56.621653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:56.622005 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 08:46:56.622311 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 08:46:56.622871 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":450,"threads_started":1}
I20260808 08:46:56.626510 9225 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43863
I20260808 08:46:56.626935 9225 heartbeater.cc:464] Registering TS with master...
I20260808 08:46:56.627938 9225 heartbeater.cc:511] Master 127.8.149.126:43863 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
I20260808 08:46:56.631690 8889 ts_manager.cc:194] Registered new tserver with Master: 450e4cc8f142485e8d26e1fec901999d (127.8.149.65:42195)
I20260808 08:46:56.634083 8889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:34209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:46:56.654980 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:57.069535 9234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:57.069813 9234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:57.069933 9234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:57.077054 9234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:57.077165 9234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:57.077289 9234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:46:57.087007 9234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:57.088201 9234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:57.089480 9234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:57.102752 9239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:57.102794 9242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:57.102816 9240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:57.103404 9234 server_base.cc:1034] running on GCE node
I20260808 08:46:57.103950 9234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:57.104841 9234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:57.106062 9234 hybrid_clock.cc:648] HybridClock initialized: now 1786178817106020 us; error 31 us; skew 500 ppm
I20260808 08:46:57.106374 9234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:57.109658 9234 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:46:57.111032 9234 webserver.cc:460] Webserver started at http://127.8.149.66:37071/ using document root <none> and password file <none>
I20260808 08:46:57.111765 9234 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:57.111909 9234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:57.112255 9234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:57.115149 9234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "5aa359a3907f446bba49666299fb6d52"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "15905575d365e1ddb477fc91604d6400"
server_key_iv: "3cc8ad31da851804bec4b95556f80345"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.115875 9234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "5aa359a3907f446bba49666299fb6d52"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "15905575d365e1ddb477fc91604d6400"
server_key_iv: "3cc8ad31da851804bec4b95556f80345"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.120854 9234 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:46:57.124464 9256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.125845 9234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:46:57.126017 9234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "5aa359a3907f446bba49666299fb6d52"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "15905575d365e1ddb477fc91604d6400"
server_key_iv: "3cc8ad31da851804bec4b95556f80345"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.126195 9234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:57.141516 9234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:57.145587 9234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:57.145972 9234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:57.147043 9234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:46:57.148525 9234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:46:57.148641 9234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.148815 9234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:46:57.148892 9234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.193575 9234 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:34141
I20260808 08:46:57.193665 9446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:34141 every 8 connection(s)
I20260808 08:46:57.195093 9234 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:46:57.204648 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9234
I20260808 08:46:57.204927 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:46:57.205605 8789 external_mini_cluster.cc:1428] Setting key 3fba7f5ff94fcbf79e5dd6bb4a674e2a
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:46:57.222146 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.198620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:48925 (local address 127.8.149.126:43863)
0808 08:46:57.199334 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:57.199339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:57.200470 (+ 1131us) server_negotiation.cc:407] Connection header received
0808 08:46:57.202583 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:57.202587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:57.202653 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:57.202757 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:57.204616 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.205924 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.208336 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.209434 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.209583 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.213539 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:57.213549 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:57.213557 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:57.213603 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:57.218324 (+ 4721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.219129 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.219137 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.219144 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.219309 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.219927 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.219935 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.219942 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.220459 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:57.220632 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:57.221309 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 08:46:57.221608 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":491,"threads_started":1}
I20260808 08:46:57.222635 9454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.199057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43863 (local address 127.8.149.66:48925)
0808 08:46:57.200287 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:57.200341 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:57.202350 (+ 2009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:57.202965 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:57.202971 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:57.203615 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:57.204419 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:57.204438 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.206084 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.206088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:57.208188 (+ 2100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:57.208200 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.209672 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.209678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:57.209863 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.210596 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:57.210617 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:57.213225 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:57.218489 (+ 5264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:57.218495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:57.218505 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:57.218988 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:57.219431 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:57.219434 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:57.219436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:57.219691 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:57.220593 (+ 902us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:57.220599 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:57.220929 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 08:46:57.221151 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 08:46:57.221491 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":613,"threads_started":1}
I20260808 08:46:57.224138 9447 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43863
I20260808 08:46:57.224498 9447 heartbeater.cc:464] Registering TS with master...
I20260808 08:46:57.225512 9447 heartbeater.cc:511] Master 127.8.149.126:43863 requested a full tablet report, sending...
I20260808 08:46:57.227401 8889 ts_manager.cc:194] Registered new tserver with Master: 5aa359a3907f446bba49666299fb6d52 (127.8.149.66:34141)
I20260808 08:46:57.228336 8889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:48925
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:46:57.253022 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:35491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:46:57.637799 9225 heartbeater.cc:503] Master 127.8.149.126:43863 was elected leader, sending a full tablet report...
W20260808 08:46:57.663646 9458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:57.664042 9458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:57.664245 9458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:57.676023 9458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:57.676186 9458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:57.676388 9458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:46:57.690479 9458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:35491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:57.691789 9458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:57.693174 9458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:57.705860 9471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:57.705971 9466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:57.705957 9467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:57.706722 9458 server_base.cc:1034] running on GCE node
I20260808 08:46:57.707288 9458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:57.708251 9458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:57.709455 9458 hybrid_clock.cc:648] HybridClock initialized: now 1786178817709417 us; error 37 us; skew 500 ppm
I20260808 08:46:57.709787 9458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:57.713019 9458 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:46:57.714507 9458 webserver.cc:460] Webserver started at http://127.8.149.67:34105/ using document root <none> and password file <none>
I20260808 08:46:57.715137 9458 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:57.715284 9458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:57.715603 9458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:57.718457 9458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "ab3d4b1c39cf4cd2966d8135910bc349"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "8267d8c3ae078ae1fdab05fb7437aea6"
server_key_iv: "d9ba4e50a29c9432637f0f220ea21787"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.719486 9458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "ab3d4b1c39cf4cd2966d8135910bc349"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "8267d8c3ae078ae1fdab05fb7437aea6"
server_key_iv: "d9ba4e50a29c9432637f0f220ea21787"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.724700 9458 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260808 08:46:57.728037 9480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.729342 9458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:57.729496 9458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "ab3d4b1c39cf4cd2966d8135910bc349"
format_stamp: "Formatted at 2026-08-08 08:46:57 on dist-test-slave-7vjv"
server_key: "8267d8c3ae078ae1fdab05fb7437aea6"
server_key_iv: "d9ba4e50a29c9432637f0f220ea21787"
server_key_version: "encryptionkey@0"
I20260808 08:46:57.729669 9458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:57.743963 9458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:57.747534 9458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:57.747802 9458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:57.748679 9458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:46:57.750101 9458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:46:57.750218 9458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.750383 9458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:46:57.750450 9458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:57.795955 9458 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:39317
I20260808 08:46:57.796054 9658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:39317 every 8 connection(s)
I20260808 08:46:57.797466 9458 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:46:57.801517 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9458
I20260808 08:46:57.801756 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:46:57.802338 8789 external_mini_cluster.cc:1428] Setting key a84df2e9842da0cbd7812fd15e1d848c
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:46:57.818809 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.800742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:57071 (local address 127.8.149.126:43863)
0808 08:46:57.801260 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:57.801266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:57.802698 (+ 1432us) server_negotiation.cc:407] Connection header received
0808 08:46:57.804676 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:57.804683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:57.804765 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:57.804885 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:57.807055 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.807930 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.809493 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.809867 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.809953 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.813124 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:57.813128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:57.813131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:57.813182 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:57.815781 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.816462 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.816465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.816467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.816574 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.817020 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.817027 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.817030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.817295 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:57.817455 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:57.818238 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 08:46:57.818428 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":248,"threads_started":1}
I20260808 08:46:57.819630 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.801351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43863 (local address 127.8.149.67:57071)
0808 08:46:57.802507 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:57.802560 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:57.804420 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:57.805111 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:57.805124 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:57.805991 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:57.806858 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:57.806878 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.808069 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.808072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:57.809360 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:57.809372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.810058 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.810062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:57.810234 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.810818 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:57.810839 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:57.812954 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:57.815898 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:57.815904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:57.815934 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:57.816357 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:57.816683 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:57.816689 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:57.816692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:57.816880 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:57.817436 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:57.817443 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:57.817811 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 08:46:57.818122 (+ 311us) client_negotiation.cc:240] Negotiation successful
0808 08:46:57.818570 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":592,"threads_started":1}
I20260808 08:46:57.820772 9659 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43863
I20260808 08:46:57.821024 9659 heartbeater.cc:464] Registering TS with master...
I20260808 08:46:57.821623 9659 heartbeater.cc:511] Master 127.8.149.126:43863 requested a full tablet report, sending...
I20260808 08:46:57.822882 8889 ts_manager.cc:194] Registered new tserver with Master: ab3d4b1c39cf4cd2966d8135910bc349 (127.8.149.67:39317)
I20260808 08:46:57.823679 8889 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:57071
I20260808 08:46:57.831110 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:46:57.879065 9675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.864789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.8.149.65:42195)
0808 08:46:57.865460 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:57.865467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:57.865493 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:46:57.865592 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:57.865598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:57.865809 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:57.865965 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:57.867357 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.868384 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.869588 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.870101 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.870190 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.874055 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:57.874065 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:57.874077 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:57.874106 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:57.876737 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.877305 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.877310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.877313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.877424 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.877744 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.877747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.877749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.878053 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:57.878275 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:57.878453 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 08:46:57.878629 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":352,"threads_started":1}
W20260808 08:46:57.880455 9084 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49044
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:46:57 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:46:57.930012 9675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.916628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.8.149.65:42195)
0808 08:46:57.916856 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:57.916863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:57.917164 (+ 301us) server_negotiation.cc:407] Connection header received
0808 08:46:57.917366 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:57.917370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:57.917431 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:57.917535 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:57.918807 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.919469 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.920748 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.921172 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.921296 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.925037 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:57.925042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:57.925045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:57.925074 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:57.927384 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.928144 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.928149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.928156 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.928285 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.928637 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.928642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.928645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.928929 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:57.929169 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:57.929460 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:46:57.929686 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:46:57.931957 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9003
I20260808 08:46:57.943866 9675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:57.932990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49056 (local address 127.8.149.65:42195)
0808 08:46:57.933139 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:57.933142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:57.933608 (+ 466us) server_negotiation.cc:407] Connection header received
0808 08:46:57.933740 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:57.933744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:57.933795 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:57.933895 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:57.935021 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.935791 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.937063 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:57.937455 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:57.937547 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:57.939516 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:57.939520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:57.939523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:57.939547 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:57.941912 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.942478 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.942481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.942483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.942598 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:57.942871 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:57.942874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:57.942875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:57.943129 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:57.943294 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:57.943501 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 08:46:57.943631 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:46:57.944630 9215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:58.030079 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9003
I20260808 08:46:58.057395 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9234
Aug 08 08:46:58 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:46:58.075418 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:58.058267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54140 (local address 127.8.149.66:34141)
0808 08:46:58.058799 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:58.058806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:58.058832 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:46:58.058906 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:58.058914 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:58.059140 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:58.059346 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:58.061046 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:58.062188 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:58.063741 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:58.064461 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:58.064631 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:58.069132 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:58.069145 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:58.069158 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:58.069193 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:58.072071 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:58.072932 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:58.072942 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:58.072946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:58.073101 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:58.073584 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:58.073592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:58.073596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:58.073992 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:58.074367 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:58.074706 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 08:46:58.075025 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":257,"threads_started":1}
I20260808 08:46:58.076896 9441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:58.154652 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9234
I20260808 08:46:58.179945 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9458
Aug 08 08:46:58 dist-test-slave-7vjv krb5kdc[8801](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:46:58.196249 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:58.180943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55504 (local address 127.8.149.67:39317)
0808 08:46:58.181604 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:58.181611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:58.181640 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:46:58.181700 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:58.181706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:58.181919 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:58.182059 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:58.183280 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:58.184445 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:58.185742 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:58.186260 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:58.186358 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:58.190470 (+ 4112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:58.190482 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:58.190495 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:58.190528 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:58.193515 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:58.194187 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:58.194194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:58.194197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:58.194326 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:58.194747 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:58.194751 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:58.194753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:58.195116 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:58.195394 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:58.195657 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 08:46:58.195852 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":336,"threads_started":1}
I20260808 08:46:58.197588 9651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:58.276168 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9458
I20260808 08:46:58.297217 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 8824
I20260808 08:46:58.298434 8947 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:58.403759 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 8824
2026-08-08T08:46:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4554 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:58 dist-test-slave-7vjv krb5kdc[9697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:58 dist-test-slave-7vjv krb5kdc[9697](info): set up 2 sockets
Aug 08 08:46:58 dist-test-slave-7vjv krb5kdc[9697](info): commencing operation
krb5kdc: starting...
W20260808 08:46:59.714402 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.006s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:46:59 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:46:59.900074 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33055
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:33055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:00.218278 9722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:00.218561 9722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:00.218724 9722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:00.226125 9722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:00.226234 9722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:00.226375 9722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:00.226485 9722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:00.226573 9722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:00.236500 9722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:33055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:00.237814 9722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:00.239226 9722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:00.251482 9735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:00.251567 9734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:00.251535 9738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:00.252897 9722 server_base.cc:1034] running on GCE node
I20260808 08:47:00.253613 9722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:00.254916 9722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:00.256191 9722 hybrid_clock.cc:648] HybridClock initialized: now 1786178820256120 us; error 29 us; skew 500 ppm
I20260808 08:47:00.256573 9722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:00 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:00.263010 9722 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:00.264460 9722 webserver.cc:460] Webserver started at http://127.8.149.126:42867/ using document root <none> and password file <none>
I20260808 08:47:00.265100 9722 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:00.265200 9722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:00.265466 9722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:00.268478 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "08604e836441aa2e29d2210ebfb88c90"
server_key_iv: "2754078ca800595b44d02de426007695"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.269157 9722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "08604e836441aa2e29d2210ebfb88c90"
server_key_iv: "2754078ca800595b44d02de426007695"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.274211 9722 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 08:47:00.277508 9749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:00.278761 9722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:00.278895 9722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "08604e836441aa2e29d2210ebfb88c90"
server_key_iv: "2754078ca800595b44d02de426007695"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.279055 9722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:00.300659 9722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:00.304404 9722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:00.304703 9722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:00.322536 9722 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:33055
I20260808 08:47:00.322558 9826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:33055 every 8 connection(s)
I20260808 08:47:00.323745 9722 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:00.326596 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9722
I20260808 08:47:00.326857 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:00.327759 8789 external_mini_cluster.cc:1428] Setting key 224a64a94e6b800403f80b249592a6ba
I20260808 08:47:00.328465 9827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:00 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:00.345199 9827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080: Bootstrap starting.
I20260808 08:47:00.348249 9827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:00.349229 9827 log.cc:824] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:00.351948 9827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080: No bootstrap required, opened a new log
I20260808 08:47:00.352607 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:00.329848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38438 (local address 127.8.149.126:33055)
0808 08:47:00.330581 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:00.330591 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:00.330630 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:47:00.332372 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:00.332399 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:00.332737 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:00.333046 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:00.334788 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.337071 (+ 2283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.339093 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.340220 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.340406 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:00.345723 (+ 5317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:00.345730 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:00.345742 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:00.345779 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:00.348755 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:00.349379 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:00.349391 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:00.349396 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:00.349554 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:00.349903 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:00.349910 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:00.349914 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:00.350428 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:00.350716 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:00.351204 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 08:47:00.351572 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":327,"threads_started":1}
I20260808 08:47:00.359094 9827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } }
I20260808 08:47:00.359429 9827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:00.359532 9827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a3d1fea1edb44dd8cf8d9b8c2650080, State: Initialized, Role: FOLLOWER
I20260808 08:47:00.360044 9827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } }
I20260808 08:47:00.360317 9827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:00.360461 9827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:00.360622 9827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:00.362638 9827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } }
I20260808 08:47:00.363101 9827 leader_election.cc:302] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a3d1fea1edb44dd8cf8d9b8c2650080; no voters:
I20260808 08:47:00.363626 9827 leader_election.cc:288] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:00.363767 9833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:00.364890 9833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [term 1 LEADER]: Becoming Leader. State: Replica: 5a3d1fea1edb44dd8cf8d9b8c2650080, State: Running, Role: LEADER
I20260808 08:47:00.365368 9833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } }
I20260808 08:47:00.365669 9827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:00.368062 9835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a3d1fea1edb44dd8cf8d9b8c2650080. Latest consensus state: current_term: 1 leader_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } } }
I20260808 08:47:00.368425 9835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:00.368966 9834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a3d1fea1edb44dd8cf8d9b8c2650080" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33055 } } }
I20260808 08:47:00.369302 9834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:00.376605 9842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:00.380988 9842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:00.389379 9842 catalog_manager.cc:1347] Generated new cluster ID: 54bed92e29ee417ca3c0f6ff61974052
I20260808 08:47:00.389484 9842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:00.400755 9842 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:00.402244 9842 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:00.411352 9842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a3d1fea1edb44dd8cf8d9b8c2650080: Generated new TSK 0
I20260808 08:47:00.412160 9842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:00.454913 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:00.777586 9877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:00.777827 9877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:00.778033 9877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:00.785665 9877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:00.785759 9877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:00.785862 9877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:00.795136 9877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:00.796270 9877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:00.797425 9877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:00.809829 9891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:00.809850 9887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:00.809824 9893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:00.810413 9877 server_base.cc:1034] running on GCE node
I20260808 08:47:00.811069 9877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:00.811899 9877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:00.813163 9877 hybrid_clock.cc:648] HybridClock initialized: now 1786178820813091 us; error 60 us; skew 500 ppm
I20260808 08:47:00.813459 9877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:00 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:00.816566 9877 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:00.817850 9877 webserver.cc:460] Webserver started at http://127.8.149.65:46319/ using document root <none> and password file <none>
I20260808 08:47:00.818563 9877 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:00.818724 9877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:00.819036 9877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:00.821857 9877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "c1ff6dd060604108bf39463587b323fa"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "5213f0869ae3de71a51afbd287a84821"
server_key_iv: "13f8a9cd457040e0b7c788e7fa503120"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.822654 9877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "c1ff6dd060604108bf39463587b323fa"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "5213f0869ae3de71a51afbd287a84821"
server_key_iv: "13f8a9cd457040e0b7c788e7fa503120"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.827641 9877 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:47:00.831102 9908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:00.832353 9877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:47:00.832530 9877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "c1ff6dd060604108bf39463587b323fa"
format_stamp: "Formatted at 2026-08-08 08:47:00 on dist-test-slave-7vjv"
server_key: "5213f0869ae3de71a51afbd287a84821"
server_key_iv: "13f8a9cd457040e0b7c788e7fa503120"
server_key_version: "encryptionkey@0"
I20260808 08:47:00.832726 9877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:00.853431 9877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:00.857977 9877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:00.858245 9877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:00.859131 9877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:00.860421 9877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:00.860496 9877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:00.860641 9877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:00.860702 9877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:00.895809 9877 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:44151
I20260808 08:47:00.895860 10080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:44151 every 8 connection(s)
I20260808 08:47:00.897186 9877 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:00.900789 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9877
I20260808 08:47:00.901108 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:00.901835 8789 external_mini_cluster.cc:1428] Setting key 7839daacb0c9f45b8f30d1f8ad82620b
Aug 08 08:47:00 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178820, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:00.916347 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:00.899584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42419 (local address 127.8.149.126:33055)
0808 08:47:00.900129 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:00.900136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:00.901225 (+ 1089us) server_negotiation.cc:407] Connection header received
0808 08:47:00.903081 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:00.903088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:00.903176 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:00.903284 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:00.904822 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.905482 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.906937 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.907300 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.907419 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:00.910808 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:00.910812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:00.910815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:00.910843 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:00.913504 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:00.914166 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:00.914170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:00.914172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:00.914299 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:00.914722 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:00.914726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:00.914733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:00.914993 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:00.915140 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:00.915747 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 08:47:00.915973 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":255,"threads_started":1}
I20260808 08:47:00.917186 10085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:00.900270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33055 (local address 127.8.149.65:42419)
0808 08:47:00.901061 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:00.901118 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:00.902848 (+ 1730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:00.903524 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:00.903535 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:00.904066 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:00.904676 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:00.904691 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.905697 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.905701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:00.906802 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:00.906813 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:00.907506 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:00.907514 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:00.907740 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:00.908404 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:00.908425 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:00.910606 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:00.913647 (+ 3041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:00.913654 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:00.913666 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:00.914040 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:00.914419 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:00.914424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:00.914427 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:00.914593 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:00.915116 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:00.915123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:00.915417 (+ 294us) client_negotiation.cc:769] Sending connection context
0808 08:47:00.915651 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 08:47:00.916112 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":340,"threads_started":1}
I20260808 08:47:00.918540 10081 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33055
I20260808 08:47:00.918829 10081 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:00.919483 10081 heartbeater.cc:511] Master 127.8.149.126:33055 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
I20260808 08:47:00.921487 9775 ts_manager.cc:194] Registered new tserver with Master: c1ff6dd060604108bf39463587b323fa (127.8.149.65:44151)
I20260808 08:47:00.923007 9775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:42419
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:00.945236 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:01.261173 10090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:01.261422 10090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:01.261560 10090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:01.268438 10090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:01.268530 10090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:01.268738 10090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:01.277910 10090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:01.279029 10090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:01.280334 10090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:01.293228 10099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:01.293147 10098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:01.293191 10101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:01.293983 10090 server_base.cc:1034] running on GCE node
I20260808 08:47:01.294499 10090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:01.295286 10090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:01.296465 10090 hybrid_clock.cc:648] HybridClock initialized: now 1786178821296421 us; error 71 us; skew 500 ppm
I20260808 08:47:01.296715 10090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:01 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178821, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:01.299557 10090 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:01.300966 10090 webserver.cc:460] Webserver started at http://127.8.149.66:41441/ using document root <none> and password file <none>
I20260808 08:47:01.301554 10090 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:01.301682 10090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:01.301964 10090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:01.304553 10090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "1787528fe59e4394821cbd17b9f4f65f"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "92a8ace574194900b92593ed3a0d4ccc"
server_key_iv: "b6cc0e9625fb2ecf67ed19ba5a387195"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.305301 10090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "1787528fe59e4394821cbd17b9f4f65f"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "92a8ace574194900b92593ed3a0d4ccc"
server_key_iv: "b6cc0e9625fb2ecf67ed19ba5a387195"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.310063 10090 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:47:01.313136 10112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.314247 10090 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:47:01.314422 10090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "1787528fe59e4394821cbd17b9f4f65f"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "92a8ace574194900b92593ed3a0d4ccc"
server_key_iv: "b6cc0e9625fb2ecf67ed19ba5a387195"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.314615 10090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:01.341223 10090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:01.344578 10090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:01.344834 10090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:01.345636 10090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:01.346812 10090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:01.346913 10090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.347049 10090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:01.347127 10090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.379707 10090 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:34889
I20260808 08:47:01.379788 10287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:34889 every 8 connection(s)
I20260808 08:47:01.380966 10090 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:01.391222 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10090
I20260808 08:47:01.391418 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:01.391826 8789 external_mini_cluster.cc:1428] Setting key b88286cf5e33632a930fb9c7102766e6
Aug 08 08:47:01 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178821, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:01.402027 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.383626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:58713 (local address 127.8.149.126:33055)
0808 08:47:01.383803 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.383808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.385182 (+ 1374us) server_negotiation.cc:407] Connection header received
0808 08:47:01.387141 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.387147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.387245 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.387373 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:01.389033 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.389804 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.391490 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.391964 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.392071 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.395955 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:01.395960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:01.395963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:01.395994 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:01.398618 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.399538 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.399541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.399544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.399684 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.400209 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.400215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.400220 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.400574 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:01.400740 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.401340 (+ 600us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.401591 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:47:01.402570 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.384192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33055 (local address 127.8.149.66:58713)
0808 08:47:01.385005 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:01.385050 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:01.386842 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:01.387626 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:01.387634 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:01.388230 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:01.388815 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.388835 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.389983 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.389988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.391261 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.391275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.392223 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.392234 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.392588 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.393341 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:01.393363 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:01.395747 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:01.398781 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:01.398792 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:01.398809 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:01.399415 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:01.399789 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:01.399796 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:01.399802 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:01.400066 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:01.400690 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:01.400695 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:01.400993 (+ 298us) client_negotiation.cc:769] Sending connection context
0808 08:47:01.401195 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 08:47:01.401534 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":304,"threads_started":1}
I20260808 08:47:01.403884 10289 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33055
I20260808 08:47:01.404206 10289 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:01.405110 10289 heartbeater.cc:511] Master 127.8.149.126:33055 requested a full tablet report, sending...
I20260808 08:47:01.406718 9775 ts_manager.cc:194] Registered new tserver with Master: 1787528fe59e4394821cbd17b9f4f65f (127.8.149.66:34889)
I20260808 08:47:01.407502 9775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:58713
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:01.435047 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:01.749913 10296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:01.750226 10296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:01.750394 10296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:01.757499 10296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:01.757633 10296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:01.757791 10296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:01.767330 10296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33055
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:01.768524 10296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:01.769788 10296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:01.782651 10303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:01.782588 10305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:01.782956 10307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:01.783687 10296 server_base.cc:1034] running on GCE node
I20260808 08:47:01.784293 10296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:01.785151 10296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:01.786373 10296 hybrid_clock.cc:648] HybridClock initialized: now 1786178821786327 us; error 53 us; skew 500 ppm
I20260808 08:47:01.786711 10296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:01 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178821, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:01.789745 10296 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:01.791108 10296 webserver.cc:460] Webserver started at http://127.8.149.67:39605/ using document root <none> and password file <none>
I20260808 08:47:01.791738 10296 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:01.791877 10296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:01.792243 10296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:01.795001 10296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "3a11b0c1d87944458ca8bf22488ab610"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "c5e6fab1a86ad3b502e2761e46ea28f0"
server_key_iv: "8fcbb76745966f45e3a7983c05977095"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.795768 10296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "3a11b0c1d87944458ca8bf22488ab610"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "c5e6fab1a86ad3b502e2761e46ea28f0"
server_key_iv: "8fcbb76745966f45e3a7983c05977095"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.800652 10296 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:47:01.803859 10315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.805065 10296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:47:01.805224 10296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "3a11b0c1d87944458ca8bf22488ab610"
format_stamp: "Formatted at 2026-08-08 08:47:01 on dist-test-slave-7vjv"
server_key: "c5e6fab1a86ad3b502e2761e46ea28f0"
server_key_iv: "8fcbb76745966f45e3a7983c05977095"
server_key_version: "encryptionkey@0"
I20260808 08:47:01.805415 10296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:01.827450 10296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:01.831602 10296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:01.831885 10296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:01.832810 10296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:01.833961 10296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:01.834053 10296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.834179 10296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:01.834244 10296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:01.867233 10296 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:34757
I20260808 08:47:01.867308 10500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:34757 every 8 connection(s)
I20260808 08:47:01.868474 10296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:01.869088 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10296
I20260808 08:47:01.869294 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:01.869865 8789 external_mini_cluster.cc:1428] Setting key efccd09b8240f99f28c85c346cc002da
Aug 08 08:47:01 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178821, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:01.889374 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.871097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:39799 (local address 127.8.149.126:33055)
0808 08:47:01.871284 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.871290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.872801 (+ 1511us) server_negotiation.cc:407] Connection header received
0808 08:47:01.874673 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.874677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.874741 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.874821 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:01.876349 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.877164 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.878672 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.879028 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.879119 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.882425 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:01.882430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:01.882433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:01.882462 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:01.885851 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.886643 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.886646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.886648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.886805 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.887328 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.887347 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.887352 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.887820 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:01.887957 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.888810 (+ 853us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.889004 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:47:01.890264 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.871764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33055 (local address 127.8.149.67:39799)
0808 08:47:01.872658 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:01.872713 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:01.874445 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:01.875023 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:01.875030 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:01.875584 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:01.876165 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.876194 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.877289 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.877293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.878559 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.878570 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.879195 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.879199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.879364 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.879967 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:01.879987 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:01.882197 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:01.885971 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:01.885977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:01.885987 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:01.886508 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:01.886926 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:01.886930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:01.886934 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:01.887210 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:01.887963 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:01.887992 (+ 29us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:01.888440 (+ 448us) client_negotiation.cc:769] Sending connection context
0808 08:47:01.888719 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 08:47:01.889172 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":375,"threads_started":1}
I20260808 08:47:01.891428 10502 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33055
I20260808 08:47:01.891754 10502 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:01.892612 10502 heartbeater.cc:511] Master 127.8.149.126:33055 requested a full tablet report, sending...
I20260808 08:47:01.894038 9775 ts_manager.cc:194] Registered new tserver with Master: 3a11b0c1d87944458ca8bf22488ab610 (127.8.149.67:34757)
I20260808 08:47:01.894850 9775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:39799
I20260808 08:47:01.897547 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:01.917577 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.905240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38440 (local address 127.8.149.126:33055)
0808 08:47:01.905444 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.905449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.906102 (+ 653us) server_negotiation.cc:407] Connection header received
0808 08:47:01.906256 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.906259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.906324 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.906403 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:01.908065 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.908818 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.910179 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.910533 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.910617 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.912885 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:01.912890 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:01.912893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:01.912924 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:01.915149 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.915701 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.915705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.915707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.915849 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:01.916315 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:01.916336 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:01.916338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:01.916634 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:01.916828 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.917108 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.917253 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:47:01.925868 10081 heartbeater.cc:503] Master 127.8.149.126:33055 was elected leader, sending a full tablet report...
I20260808 08:47:01.925549 9775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:01.936247 9775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:01.972532 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.951941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.8.149.66:34889)
0808 08:47:01.953653 (+ 1712us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.953676 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.955533 (+ 1857us) server_negotiation.cc:407] Connection header received
0808 08:47:01.955726 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.955737 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.956068 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.957423 (+ 1355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:01.957806 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.961816 (+ 4010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.968551 (+ 6735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.970789 (+ 2238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.970965 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.971182 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.971841 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.972055 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1457,"thread_start_us":1193,"threads_started":1}
I20260808 08:47:01.973212 10519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.951647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:34889 (local address 127.0.0.1:40832)
0808 08:47:01.954364 (+ 2717us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:01.954418 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:01.954692 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:01.956414 (+ 1722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:01.956421 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:01.956454 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:01.957122 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.957141 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.961952 (+ 4811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.961957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.968280 (+ 6323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.968299 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.971025 (+ 2726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.971032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.971344 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.971514 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 08:47:01.971754 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 08:47:01.972008 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2353,"thread_start_us":2253,"threads_started":1}
I20260808 08:47:01.978838 10185 tablet_service.cc:1467] Processing CreateTablet for tablet 427c9a55479e434db2c2204b7a03597a (DEFAULT_TABLE table=test-table [id=ac65e3dbb7b14a31b03e55aad18bfb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:01.980429 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.951885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:34757 (local address 127.0.0.1:53108)
0808 08:47:01.956481 (+ 4596us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:01.956500 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:01.960764 (+ 4264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:01.961873 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:01.961880 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:01.961907 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:01.970560 (+ 8653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.970577 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.974176 (+ 3599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.974184 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.977179 (+ 2995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.977202 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.979472 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.979478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.979701 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.979743 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:47:01.979805 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 08:47:01.979928 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4439,"mutex_wait_us":1,"thread_start_us":4244,"threads_started":1}
I20260808 08:47:01.980698 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.952569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.8.149.67:34757)
0808 08:47:01.955801 (+ 3232us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.955809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.956625 (+ 816us) server_negotiation.cc:407] Connection header received
0808 08:47:01.960959 (+ 4334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.960968 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.961266 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.961428 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:01.971022 (+ 9594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.974040 (+ 3018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.977423 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.979262 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.979416 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.979825 (+ 409us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.979932 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.980235 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1720,"thread_start_us":1338,"threads_started":1}
I20260808 08:47:01.981212 10526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.953674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44151 (local address 127.0.0.1:46884)
0808 08:47:01.970894 (+ 17220us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:01.970913 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:01.971025 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:01.971909 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:01.971913 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:01.971937 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:01.973467 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.973486 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.975538 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.975543 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.978212 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:01.978225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.980302 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.980309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:01.980544 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.980584 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:47:01.980665 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 08:47:01.980795 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17073,"thread_start_us":16870,"threads_started":1}
I20260808 08:47:01.981421 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:01.953506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46884 (local address 127.8.149.65:44151)
0808 08:47:01.969227 (+ 15721us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:01.969242 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:01.971255 (+ 2013us) server_negotiation.cc:407] Connection header received
0808 08:47:01.971375 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:01.971401 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:01.971659 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:01.972282 (+ 623us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:01.973666 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.975215 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.978352 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:01.979617 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:01.979764 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:01.980072 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:01.980857 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 08:47:01.981054 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15390,"thread_start_us":15756,"threads_started":1}
I20260808 08:47:01.981460 10185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c9a55479e434db2c2204b7a03597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:01.984907 10403 tablet_service.cc:1467] Processing CreateTablet for tablet 427c9a55479e434db2c2204b7a03597a (DEFAULT_TABLE table=test-table [id=ac65e3dbb7b14a31b03e55aad18bfb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:01.986181 10403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c9a55479e434db2c2204b7a03597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:01.986007 9982 tablet_service.cc:1467] Processing CreateTablet for tablet 427c9a55479e434db2c2204b7a03597a (DEFAULT_TABLE table=test-table [id=ac65e3dbb7b14a31b03e55aad18bfb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:01.987705 9982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c9a55479e434db2c2204b7a03597a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:01.998672 10527 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Bootstrap starting.
I20260808 08:47:02.002130 10527 tablet_bootstrap.cc:654] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:02.003651 10527 log.cc:824] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:02.005074 10529 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Bootstrap starting.
I20260808 08:47:02.006855 10535 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Bootstrap starting.
I20260808 08:47:02.006939 10527 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: No bootstrap required, opened a new log
I20260808 08:47:02.007221 10527 ts_tablet_manager.cc:1397] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 08:47:02.009598 10529 tablet_bootstrap.cc:654] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:02.010351 10535 tablet_bootstrap.cc:654] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:02.010776 10529 log.cc:824] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:02.011432 10535 log.cc:824] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:02.013832 10529 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: No bootstrap required, opened a new log
I20260808 08:47:02.014147 10529 ts_tablet_manager.cc:1397] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:47:02.014544 10535 tablet_bootstrap.cc:492] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: No bootstrap required, opened a new log
I20260808 08:47:02.014828 10535 ts_tablet_manager.cc:1397] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:47:02.016296 10527 raft_consensus.cc:348] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.016650 10527 raft_consensus.cc:374] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:02.016770 10527 raft_consensus.cc:729] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a11b0c1d87944458ca8bf22488ab610, State: Initialized, Role: FOLLOWER
I20260808 08:47:02.017336 10527 consensus_queue.cc:260] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.018589 10502 heartbeater.cc:503] Master 127.8.149.126:33055 was elected leader, sending a full tablet report...
I20260808 08:47:02.019273 10527 ts_tablet_manager.cc:1428] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 08:47:02.025790 10529 raft_consensus.cc:348] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.026280 10529 raft_consensus.cc:374] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:02.026379 10529 raft_consensus.cc:729] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1787528fe59e4394821cbd17b9f4f65f, State: Initialized, Role: FOLLOWER
I20260808 08:47:02.026225 10535 raft_consensus.cc:348] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.026665 10535 raft_consensus.cc:374] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:02.026772 10535 raft_consensus.cc:729] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ff6dd060604108bf39463587b323fa, State: Initialized, Role: FOLLOWER
I20260808 08:47:02.027252 10529 consensus_queue.cc:260] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.027397 10535 consensus_queue.cc:260] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.028561 10289 heartbeater.cc:503] Master 127.8.149.126:33055 was elected leader, sending a full tablet report...
I20260808 08:47:02.029321 10535 ts_tablet_manager.cc:1428] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Time spent starting tablet: real 0.014s user 0.006s sys 0.007s
I20260808 08:47:02.029385 10529 ts_tablet_manager.cc:1428] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260808 08:47:02.085430 10541 raft_consensus.cc:482] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:02.085785 10541 raft_consensus.cc:504] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.088171 10541 leader_election.cc:288] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1787528fe59e4394821cbd17b9f4f65f (127.8.149.66:34889), c1ff6dd060604108bf39463587b323fa (127.8.149.65:44151)
I20260808 08:47:02.096716 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.088600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:37231 (local address 127.8.149.66:34889)
0808 08:47:02.088818 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.088835 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.089273 (+ 438us) server_negotiation.cc:407] Connection header received
0808 08:47:02.089333 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.089336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.089420 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.089567 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:02.090352 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.091716 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.094091 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.095700 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.095880 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.095948 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.096357 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.096446 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:47:02.096930 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.088642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:34889 (local address 127.8.149.67:37231)
0808 08:47:02.089003 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:02.089035 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:02.089164 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:02.089597 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:02.089605 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:02.089645 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:02.090147 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:02.090167 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.091960 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.091974 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:02.093908 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:02.093920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.095905 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.095911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:02.096200 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.096236 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:47:02.096336 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:47:02.096466 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218}
I20260808 08:47:02.098354 10546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.088946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44151 (local address 127.8.149.67:42005)
0808 08:47:02.090534 (+ 1588us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:02.090551 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:02.090671 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:02.090973 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:02.090977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:02.091019 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:02.091586 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:02.091599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.093256 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.093260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:02.095728 (+ 2468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:02.095745 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.097612 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.097622 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:02.097838 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.097862 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:47:02.097951 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:47:02.098054 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1419,"thread_start_us":962,"threads_started":1}
I20260808 08:47:02.098560 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.088893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42005 (local address 127.8.149.65:44151)
0808 08:47:02.089192 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.089198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.090638 (+ 1440us) server_negotiation.cc:407] Connection header received
0808 08:47:02.090796 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.090799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.090850 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.090941 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:02.091814 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.093088 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.095894 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.097352 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.097476 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.097522 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.098108 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.098258 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:47:02.098780 10214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c9a55479e434db2c2204b7a03597a" candidate_uuid: "3a11b0c1d87944458ca8bf22488ab610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1787528fe59e4394821cbd17b9f4f65f" is_pre_election: true
I20260808 08:47:02.099653 10214 raft_consensus.cc:2454] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a11b0c1d87944458ca8bf22488ab610 in term 0.
I20260808 08:47:02.099942 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c9a55479e434db2c2204b7a03597a" candidate_uuid: "3a11b0c1d87944458ca8bf22488ab610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ff6dd060604108bf39463587b323fa" is_pre_election: true
I20260808 08:47:02.100612 10316 leader_election.cc:302] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1787528fe59e4394821cbd17b9f4f65f, 3a11b0c1d87944458ca8bf22488ab610; no voters:
I20260808 08:47:02.100765 10015 raft_consensus.cc:2454] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a11b0c1d87944458ca8bf22488ab610 in term 0.
I20260808 08:47:02.101084 10541 raft_consensus.cc:2781] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:02.101270 10541 raft_consensus.cc:482] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:02.101442 10541 raft_consensus.cc:3037] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:02.104601 10541 raft_consensus.cc:504] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.105362 10541 leader_election.cc:288] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [CANDIDATE]: Term 1 election: Requested vote from peers 1787528fe59e4394821cbd17b9f4f65f (127.8.149.66:34889), c1ff6dd060604108bf39463587b323fa (127.8.149.65:44151)
I20260808 08:47:02.105712 10214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c9a55479e434db2c2204b7a03597a" candidate_uuid: "3a11b0c1d87944458ca8bf22488ab610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1787528fe59e4394821cbd17b9f4f65f"
I20260808 08:47:02.105942 10015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c9a55479e434db2c2204b7a03597a" candidate_uuid: "3a11b0c1d87944458ca8bf22488ab610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ff6dd060604108bf39463587b323fa"
I20260808 08:47:02.106029 10214 raft_consensus.cc:3037] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:02.106230 10015 raft_consensus.cc:3037] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:02.110332 10015 raft_consensus.cc:2454] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a11b0c1d87944458ca8bf22488ab610 in term 1.
I20260808 08:47:02.110332 10214 raft_consensus.cc:2454] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a11b0c1d87944458ca8bf22488ab610 in term 1.
I20260808 08:47:02.110821 10316 leader_election.cc:302] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1787528fe59e4394821cbd17b9f4f65f, 3a11b0c1d87944458ca8bf22488ab610; no voters:
I20260808 08:47:02.111115 10541 raft_consensus.cc:2781] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:02.111766 10541 raft_consensus.cc:686] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [term 1 LEADER]: Becoming Leader. State: Replica: 3a11b0c1d87944458ca8bf22488ab610, State: Running, Role: LEADER
I20260808 08:47:02.112514 10541 consensus_queue.cc:237] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } }
I20260808 08:47:02.117724 9775 catalog_manager.cc:5495] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a11b0c1d87944458ca8bf22488ab610 (127.8.149.67). New cstate: current_term: 1 leader_uuid: "3a11b0c1d87944458ca8bf22488ab610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1787528fe59e4394821cbd17b9f4f65f" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a11b0c1d87944458ca8bf22488ab610" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1ff6dd060604108bf39463587b323fa" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44151 } health_report { overall_health: UNKNOWN } } }
W20260808 08:47:02.120258 10503 tablet.cc:2369] T 427c9a55479e434db2c2204b7a03597a P 3a11b0c1d87944458ca8bf22488ab610: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:02.133157 10290 tablet.cc:2369] T 427c9a55479e434db2c2204b7a03597a P 1787528fe59e4394821cbd17b9f4f65f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:02.149513 10082 tablet.cc:2369] T 427c9a55479e434db2c2204b7a03597a P c1ff6dd060604108bf39463587b323fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:02.164242 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.144772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.8.149.65:44151)
0808 08:47:02.145040 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.145045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.146097 (+ 1052us) server_negotiation.cc:407] Connection header received
0808 08:47:02.146326 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.146331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.146408 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.146515 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.149130 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.150230 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.151728 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.152449 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.152593 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.157935 (+ 5342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.157947 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.157961 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.157993 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.161094 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.161899 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.161913 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.161915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.162052 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.162459 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.162464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.162467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.162844 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.163208 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.163539 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.163795 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:02.216750 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.202837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.8.149.65:44151)
0808 08:47:02.203037 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.203045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.203420 (+ 375us) server_negotiation.cc:407] Connection header received
0808 08:47:02.203636 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.203639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.203697 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.203826 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.205229 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.206053 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.207231 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.207619 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.207799 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.211608 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.211612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.211615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.211644 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.214298 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.214903 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.214908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.214916 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.215040 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.215435 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.215440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.215443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.215685 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.215966 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.216209 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.216442 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:02.262281 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.248535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46920 (local address 127.8.149.65:44151)
0808 08:47:02.248734 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.248740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.249057 (+ 317us) server_negotiation.cc:407] Connection header received
0808 08:47:02.249141 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.249145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.249278 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.249419 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.251176 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.251848 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.253287 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.253714 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.253807 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.257361 (+ 3554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.257365 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.257368 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.257406 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.259939 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.260575 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.260578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.260580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.260702 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.261034 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.261038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.261040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.261341 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.261535 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.261756 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.261932 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:47:02.264484 9956 tablet_service.cc:2908] Rejecting scan request for tablet 427c9a55479e434db2c2204b7a03597a: Uninitialized: clean time has not yet been initialized
I20260808 08:47:02.268200 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9877
I20260808 08:47:02.279951 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.269012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46922 (local address 127.8.149.65:44151)
0808 08:47:02.269146 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.269150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.269528 (+ 378us) server_negotiation.cc:407] Connection header received
0808 08:47:02.269646 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.269649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.269710 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.269782 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.270846 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.271482 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.272667 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.273058 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.273156 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.275140 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.275144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.275147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.275173 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.277919 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.278498 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.278501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.278503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.278611 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.278925 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.278928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.278930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.279181 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.279398 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.279590 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.279749 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:47:02.280520 10072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:02.370167 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9877
I20260808 08:47:02.398713 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10090
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:02.413544 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.399449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.8.149.66:34889)
0808 08:47:02.399617 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.399621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.399641 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:47:02.399757 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.399761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.399823 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.399924 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.401162 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.401898 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.403190 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.403602 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.403704 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.407699 (+ 3995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.407711 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.407723 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.407755 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.411047 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.411635 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.411641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.411644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.411773 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.412180 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.412184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.412186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.412583 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.412856 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.413123 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.413288 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:47:02.414203 10281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:02.502303 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10090
I20260808 08:47:02.529156 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10296
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[9697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:02.546353 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:02.529956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.8.149.67:34757)
0808 08:47:02.530431 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:02.530585 (+ 154us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:02.530613 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:47:02.530679 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:02.530682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:02.530759 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:02.530972 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:02.532482 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.533214 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.534827 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:02.535523 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:02.535716 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:02.540714 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:02.540732 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:02.540755 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:02.540808 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:02.543499 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.544152 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.544166 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.544168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.544317 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:02.544697 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:02.544703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:02.544706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:02.545106 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:02.545417 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:02.545717 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 08:47:02.545976 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":224,"threads_started":1}
I20260808 08:47:02.547006 10492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:02.635447 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10296
I20260808 08:47:02.662281 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9722
I20260808 08:47:02.663537 9816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:02.767920 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9722
2026-08-08T08:47:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4367 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[10578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[10578](info): set up 2 sockets
Aug 08 08:47:02 dist-test-slave-7vjv krb5kdc[10578](info): commencing operation
krb5kdc: starting...
W20260808 08:47:04.063848 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.002s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:04 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:04.251072 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:43581
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:43581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:04.573439 10596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:04.573725 10596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:04.573833 10596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:04.581218 10596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:04.581314 10596 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:47:04.581359 10596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:04.581427 10596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:04.581481 10596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:04.581540 10596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:04.591619 10596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:43581
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:43581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:04.592742 10596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:04.594012 10596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:04.606367 10606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:04.606423 10610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:04.606465 10604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:04.607592 10596 server_base.cc:1034] running on GCE node
I20260808 08:47:04.608361 10596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:04.609668 10596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:04.610916 10596 hybrid_clock.cc:648] HybridClock initialized: now 1786178824610832 us; error 53 us; skew 500 ppm
I20260808 08:47:04.611236 10596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:04 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178824, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:04.614547 10596 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:04.615892 10596 webserver.cc:460] Webserver started at http://127.8.149.126:38871/ using document root <none> and password file <none>
I20260808 08:47:04.616647 10596 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:04.616781 10596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:04.617101 10596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:04.620014 10596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "d6e520b5501c4a69bfced9b9759c6858"
format_stamp: "Formatted at 2026-08-08 08:47:04 on dist-test-slave-7vjv"
server_key: "92a82e8321530654f4f3c2bb71b51f5c"
server_key_iv: "5314c5aca06053c46d4ac4d9bcdad686"
server_key_version: "encryptionkey@0"
I20260808 08:47:04.620852 10596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "d6e520b5501c4a69bfced9b9759c6858"
format_stamp: "Formatted at 2026-08-08 08:47:04 on dist-test-slave-7vjv"
server_key: "92a82e8321530654f4f3c2bb71b51f5c"
server_key_iv: "5314c5aca06053c46d4ac4d9bcdad686"
server_key_version: "encryptionkey@0"
I20260808 08:47:04.625587 10596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:47:04.628831 10626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:04.629992 10596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:04.630169 10596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "d6e520b5501c4a69bfced9b9759c6858"
format_stamp: "Formatted at 2026-08-08 08:47:04 on dist-test-slave-7vjv"
server_key: "92a82e8321530654f4f3c2bb71b51f5c"
server_key_iv: "5314c5aca06053c46d4ac4d9bcdad686"
server_key_version: "encryptionkey@0"
I20260808 08:47:04.630395 10596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:04.646347 10596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:04.650460 10596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:04.650722 10596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:04.672438 10596 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:43581
I20260808 08:47:04.672468 10740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:43581 every 8 connection(s)
I20260808 08:47:04.673691 10596 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:04.677086 10742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:04.677253 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10596
I20260808 08:47:04.677472 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:04.678124 8789 external_mini_cluster.cc:1428] Setting key b88204a90b792c7eded9e8915b9f3576
I20260808 08:47:04.690742 10742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Bootstrap starting.
Aug 08 08:47:04 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:04.693778 10742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:04.695132 10742 log.cc:824] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:04.698516 10742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: No bootstrap required, opened a new log
I20260808 08:47:04.702910 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:04.680240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35784 (local address 127.8.149.126:43581)
0808 08:47:04.681066 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:04.681081 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:04.681126 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:47:04.683531 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:04.683557 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:04.684023 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:04.684459 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:04.685685 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:04.687674 (+ 1989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:04.688978 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:04.689916 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:04.690092 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:04.694135 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:04.694147 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:04.694167 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:04.694225 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:04.698200 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:04.699047 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:04.699057 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:04.699064 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:04.699274 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:04.699694 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:04.699699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:04.699702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:04.700439 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:04.700749 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:04.701202 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 08:47:04.701613 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":337,"threads_started":1}
I20260808 08:47:04.707624 10742 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } }
I20260808 08:47:04.707913 10742 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:04.707984 10742 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e520b5501c4a69bfced9b9759c6858, State: Initialized, Role: FOLLOWER
I20260808 08:47:04.708534 10742 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } }
I20260808 08:47:04.708756 10742 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:04.708858 10742 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:04.708981 10742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:04.711138 10742 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } }
I20260808 08:47:04.711601 10742 leader_election.cc:302] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e520b5501c4a69bfced9b9759c6858; no voters:
I20260808 08:47:04.712195 10742 leader_election.cc:288] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:04.712343 10751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:04.713151 10751 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [term 1 LEADER]: Becoming Leader. State: Replica: d6e520b5501c4a69bfced9b9759c6858, State: Running, Role: LEADER
I20260808 08:47:04.713755 10751 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } }
I20260808 08:47:04.714433 10742 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:04.716717 10753 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e520b5501c4a69bfced9b9759c6858. Latest consensus state: current_term: 1 leader_uuid: "d6e520b5501c4a69bfced9b9759c6858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } } }
I20260808 08:47:04.717001 10752 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e520b5501c4a69bfced9b9759c6858" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e520b5501c4a69bfced9b9759c6858" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 43581 } } }
I20260808 08:47:04.717195 10753 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:04.717264 10752 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:04.718931 10767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:04.724110 10767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:04.732057 10767 catalog_manager.cc:1347] Generated new cluster ID: ab3f063e4d8640edb27cdec18899f8a3
I20260808 08:47:04.732168 10767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:04.749945 10767 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:04.751142 10767 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:04.756635 10767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Generated new TSK 0
I20260808 08:47:04.757442 10767 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:04.817644 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43581
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:05.138568 10788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:05.138846 10788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:05.139009 10788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:05.146145 10788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:05.146284 10788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:05.146423 10788 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:05.146552 10788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:05.156059 10788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:43581
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:05.157250 10788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:05.158476 10788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:05.171326 10795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:05.171384 10797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:05.171278 10801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:05.173141 10788 server_base.cc:1034] running on GCE node
I20260808 08:47:05.173761 10788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:05.174650 10788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:05.175930 10788 hybrid_clock.cc:648] HybridClock initialized: now 1786178825175874 us; error 44 us; skew 500 ppm
I20260808 08:47:05.176280 10788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:05 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178825, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:05.179322 10788 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:05.180781 10788 webserver.cc:460] Webserver started at http://127.8.149.65:46869/ using document root <none> and password file <none>
I20260808 08:47:05.181456 10788 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:05.181602 10788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:05.181915 10788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:05.184640 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "651b3759ab7d4344a221d7ed4b6c55df"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "ea30c1138333a16cc125a8e1d7bb3d63"
server_key_iv: "5e60e9e8fe026f00f177c82b2094e3db"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.185487 10788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "651b3759ab7d4344a221d7ed4b6c55df"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "ea30c1138333a16cc125a8e1d7bb3d63"
server_key_iv: "5e60e9e8fe026f00f177c82b2094e3db"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.190371 10788 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:05.193763 10808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:05.195113 10788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:05.195309 10788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "651b3759ab7d4344a221d7ed4b6c55df"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "ea30c1138333a16cc125a8e1d7bb3d63"
server_key_iv: "5e60e9e8fe026f00f177c82b2094e3db"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.195549 10788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:05.227095 10788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:05.230624 10788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:05.230867 10788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:05.233590 10788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:05.233721 10788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:05.233908 10788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:05.234025 10788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 08:47:05 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178825, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:05.256044 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.234069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:57951 (local address 127.8.149.126:43581)
0808 08:47:05.234672 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:05.234681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:05.235561 (+ 880us) server_negotiation.cc:407] Connection header received
0808 08:47:05.237509 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:05.237515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:05.237595 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:05.237713 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:05.239812 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.241300 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.243702 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.244194 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.244360 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.249444 (+ 5084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:05.249451 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:05.249458 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:05.249503 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:05.252909 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.253618 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.253626 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.253629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.253748 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.254211 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.254217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.254220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.254502 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:05.254660 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:05.255370 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 08:47:05.255650 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":362,"threads_started":1}
I20260808 08:47:05.256994 10825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.234687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.65:57951)
0808 08:47:05.235421 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:05.235453 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:05.237237 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:05.237943 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:05.237950 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:05.238666 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:05.239564 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.239599 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.241484 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.241488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.243538 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.243553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.244535 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.244546 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.244927 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.245730 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:05.245770 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:05.249200 (+ 3430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:05.253056 (+ 3856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.253063 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.253076 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.253493 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.253870 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.253874 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.253878 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.254077 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.254670 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:05.254681 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:05.255013 (+ 332us) client_negotiation.cc:769] Sending connection context
0808 08:47:05.255285 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 08:47:05.255768 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":308,"threads_started":1}
I20260808 08:47:05.282481 10911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.263352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.65:46773)
0808 08:47:05.264075 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:05.264119 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:05.264275 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:05.264616 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:05.264626 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:05.265333 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:05.265846 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.265863 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.267150 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.267159 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.268890 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.268919 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.269871 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.269877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.270126 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.273567 (+ 3441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:05.273600 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:05.274812 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:05.278848 (+ 4036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.278854 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.278859 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.279353 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.279889 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.279894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.279897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.280080 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.280894 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:05.280900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:05.281150 (+ 250us) client_negotiation.cc:769] Sending connection context
0808 08:47:05.281323 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 08:47:05.281763 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":346,"threads_started":1}
I20260808 08:47:05.283411 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.263296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:46773 (local address 127.8.149.126:43581)
0808 08:47:05.263490 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:05.263497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:05.264215 (+ 718us) server_negotiation.cc:407] Connection header received
0808 08:47:05.264396 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:05.264401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:05.264480 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:05.264578 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:05.266033 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.267006 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.269056 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.269664 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.269813 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.275030 (+ 5217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:05.275039 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:05.275046 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:05.275086 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:05.278682 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.279505 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.279513 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.279518 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.279723 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.280272 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.280278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.280281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.280663 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:05.280816 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:05.282830 (+ 2014us) server_negotiation.cc:299] Negotiation successful
0808 08:47:05.283040 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:47:05.284714 10788 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34751
I20260808 08:47:05.284737 11016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34751 every 8 connection(s)
I20260808 08:47:05.286355 10788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:05.288717 11017 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43581
I20260808 08:47:05.288932 11017 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:05.289479 11017 heartbeater.cc:511] Master 127.8.149.126:43581 requested a full tablet report, sending...
I20260808 08:47:05.291754 10657 ts_manager.cc:194] Registered new tserver with Master: 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751)
I20260808 08:47:05.293469 10657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:57951
I20260808 08:47:05.296371 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10788
I20260808 08:47:05.296599 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:05.297209 8789 external_mini_cluster.cc:1428] Setting key c01aeb39a9198b46eb0f82cbfd911749
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:05.338831 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43581
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:05.653373 11025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:05.653609 11025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:05.653786 11025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:05.660720 11025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:05.660830 11025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:05.660983 11025 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:05.661123 11025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:05.670166 11025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:43581
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:05.671277 11025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:05.672999 11025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:05.687732 11031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:05.687937 11033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:05.688196 11025 server_base.cc:1034] running on GCE node
W20260808 08:47:05.688232 11030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:05.689085 11025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:05.690125 11025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:05.691387 11025 hybrid_clock.cc:648] HybridClock initialized: now 1786178825691325 us; error 37 us; skew 500 ppm
I20260808 08:47:05.691661 11025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:05 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178825, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:05.694754 11025 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:05.696166 11025 webserver.cc:460] Webserver started at http://127.8.149.66:41745/ using document root <none> and password file <none>
I20260808 08:47:05.696782 11025 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:05.696871 11025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:05.697111 11025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:05.699851 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "6ecaed3e49f84fb6b0b51250c36a362a"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "f66ebfb2b1ae2358452913f601f7c482"
server_key_iv: "19c1886b725e6b888f40d882652489ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.700676 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "6ecaed3e49f84fb6b0b51250c36a362a"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "f66ebfb2b1ae2358452913f601f7c482"
server_key_iv: "19c1886b725e6b888f40d882652489ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.705364 11025 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:47:05.709139 11049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:05.710376 11025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:47:05.710567 11025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "6ecaed3e49f84fb6b0b51250c36a362a"
format_stamp: "Formatted at 2026-08-08 08:47:05 on dist-test-slave-7vjv"
server_key: "f66ebfb2b1ae2358452913f601f7c482"
server_key_iv: "19c1886b725e6b888f40d882652489ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:05.710780 11025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:05.731546 11025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:05.735806 11025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:05.736171 11025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:05.738632 11025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:05.738744 11025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:05.738911 11025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:05.739001 11025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:47:05 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178825, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:05.761268 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.739289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:42837 (local address 127.8.149.126:43581)
0808 08:47:05.739506 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:05.739512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:05.740935 (+ 1423us) server_negotiation.cc:407] Connection header received
0808 08:47:05.743222 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:05.743228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:05.743311 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:05.743411 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:05.745661 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.746951 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.749283 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.749908 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.750037 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.754603 (+ 4566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:05.754612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:05.754618 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:05.754663 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:05.757470 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.758344 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.758350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.758354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.758547 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.759132 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.759139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.759144 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.759522 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:05.759693 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:05.760704 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0808 08:47:05.760926 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:47:05.762871 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.739819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.66:42837)
0808 08:47:05.740754 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:05.740796 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:05.742844 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:05.743925 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:05.743931 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:05.744644 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:05.745398 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.745416 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.747118 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.747125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.749139 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.749151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.750151 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.750157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.750376 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.751146 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:05.751173 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:05.754378 (+ 3205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:05.757606 (+ 3228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.757617 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.757633 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.758190 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.758679 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.758685 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.758690 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.758988 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.759701 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:05.759711 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:05.760217 (+ 506us) client_negotiation.cc:769] Sending connection context
0808 08:47:05.760597 (+ 380us) client_negotiation.cc:240] Negotiation successful
0808 08:47:05.761118 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":462,"threads_started":1}
I20260808 08:47:05.782788 11025 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:45613
I20260808 08:47:05.782944 11234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:45613 every 8 connection(s)
I20260808 08:47:05.784174 11025 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:05.785045 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11025
I20260808 08:47:05.785277 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:05.785966 8789 external_mini_cluster.cc:1428] Setting key dc4495989b8409726f0339dc2bddeea8
I20260808 08:47:05.789551 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.775581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:47175 (local address 127.8.149.126:43581)
0808 08:47:05.775791 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:05.775799 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:05.776480 (+ 681us) server_negotiation.cc:407] Connection header received
0808 08:47:05.776693 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:05.776700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:05.776787 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:05.776901 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:05.778254 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.779104 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.781638 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.782212 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.782358 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.784246 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:05.784252 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:05.784256 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:05.784294 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:05.786721 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.787452 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.787457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.787460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.787602 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:05.788045 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:05.788051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:05.788054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:05.788476 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:05.788625 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:05.789057 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 08:47:05.789265 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:47:05.789655 11210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:05.775659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.66:47175)
0808 08:47:05.776364 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:05.776379 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:05.776559 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:05.776945 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:05.776956 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:05.777641 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:05.778090 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.778105 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.779271 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.779279 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.781463 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:05.781482 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:05.782468 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:05.782481 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:05.782719 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:05.783330 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:05.783347 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:05.784035 (+ 688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:05.786851 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.786858 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.786861 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.787316 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.787734 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:05.787739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:05.787741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:05.787911 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:05.788594 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:05.788598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:05.788789 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 08:47:05.788956 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 08:47:05.789242 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":363,"threads_started":1}
I20260808 08:47:05.793443 11236 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43581
I20260808 08:47:05.794111 11236 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:05.794699 11236 heartbeater.cc:511] Master 127.8.149.126:43581 requested a full tablet report, sending...
I20260808 08:47:05.796026 10657 ts_manager.cc:194] Registered new tserver with Master: 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66:45613)
I20260808 08:47:05.796854 10657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:42837
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:05.832792 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:43581
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:06.143999 11242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:06.144343 11242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:06.144501 11242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:06.151434 11242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:06.151573 11242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:06.151724 11242 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:06.151860 11242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:06.161387 11242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:43581
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:06.162618 11242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:06.163908 11242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:06.176965 11255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:06.177027 11252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:06.177199 11251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:06.178092 11242 server_base.cc:1034] running on GCE node
I20260808 08:47:06.178639 11242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:06.179555 11242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:06.180783 11242 hybrid_clock.cc:648] HybridClock initialized: now 1786178826180726 us; error 47 us; skew 500 ppm
I20260808 08:47:06.181073 11242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:06 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:06.184317 11242 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:06.185683 11242 webserver.cc:460] Webserver started at http://127.8.149.67:46809/ using document root <none> and password file <none>
I20260808 08:47:06.186293 11242 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:06.186378 11242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:06.186651 11242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:06.189493 11242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
format_stamp: "Formatted at 2026-08-08 08:47:06 on dist-test-slave-7vjv"
server_key: "b6e8c0b03d66f5c14c63d0eeb8771925"
server_key_iv: "c7829875c6881a591a731c41e6d37a61"
server_key_version: "encryptionkey@0"
I20260808 08:47:06.190219 11242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
format_stamp: "Formatted at 2026-08-08 08:47:06 on dist-test-slave-7vjv"
server_key: "b6e8c0b03d66f5c14c63d0eeb8771925"
server_key_iv: "c7829875c6881a591a731c41e6d37a61"
server_key_version: "encryptionkey@0"
I20260808 08:47:06.195014 11242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:47:06.198448 11267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:06.199813 11242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:47:06.199996 11242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
format_stamp: "Formatted at 2026-08-08 08:47:06 on dist-test-slave-7vjv"
server_key: "b6e8c0b03d66f5c14c63d0eeb8771925"
server_key_iv: "c7829875c6881a591a731c41e6d37a61"
server_key_version: "encryptionkey@0"
I20260808 08:47:06.200289 11242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:06.216703 11242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:06.221131 11242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:06.221390 11242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:06.224006 11242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:06.224172 11242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:47:06.224321 11242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:06.224591 11242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:47:06 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:06.247156 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.224342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:37815 (local address 127.8.149.126:43581)
0808 08:47:06.224550 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.224557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.225818 (+ 1261us) server_negotiation.cc:407] Connection header received
0808 08:47:06.227907 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.227913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.228000 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.228140 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:06.230390 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.231526 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.234800 (+ 3274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.235501 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.235651 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.240506 (+ 4855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:06.240519 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:06.240523 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:06.240559 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:06.243198 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.243967 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.243977 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.243979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.244182 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.244838 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.244844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.244848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.245211 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:06.245375 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.246550 (+ 1175us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.246792 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:47:06.248157 11285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.224846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.67:37815)
0808 08:47:06.225671 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.225704 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.227579 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.228388 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.228395 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.229167 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:06.230122 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.230156 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.231697 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.231705 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.234602 (+ 2897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.234619 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.235786 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.235794 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.236028 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.236758 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:06.236797 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:06.240273 (+ 3476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:06.243365 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:06.243388 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:06.243401 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:06.243827 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:06.244293 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:06.244298 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:06.244301 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:06.244649 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:06.245470 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:06.245475 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:06.245938 (+ 463us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.246267 (+ 329us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.246799 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":323,"threads_started":1}
I20260808 08:47:06.269373 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.254163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:36645 (local address 127.8.149.126:43581)
0808 08:47:06.254384 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.254392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.255009 (+ 617us) server_negotiation.cc:407] Connection header received
0808 08:47:06.255180 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.255184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.255237 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.255330 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:06.256764 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.257452 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.259897 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.260539 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.260717 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.262562 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:06.262568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:06.262573 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:06.262611 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:06.265869 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.266707 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.266714 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.266719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.266875 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.267329 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.267334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.267337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.267730 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:06.267908 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.268830 (+ 922us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.269040 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:47:06.269346 11383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.254147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.8.149.67:36645)
0808 08:47:06.254882 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.254912 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.255071 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.255410 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.255417 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.256137 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:06.256615 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.256631 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.257598 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.257606 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.259714 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.259739 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.260945 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.260950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.261098 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.261695 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:06.261711 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:06.262370 (+ 659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:06.266001 (+ 3631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:06.266011 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:06.266015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:06.266487 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:06.267003 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:06.267009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:06.267016 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:06.267203 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:06.267861 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:06.267868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:06.268131 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.268339 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.268798 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":395,"threads_started":1}
I20260808 08:47:06.284938 11242 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:35495
I20260808 08:47:06.284958 11487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:35495 every 8 connection(s)
I20260808 08:47:06.286433 11242 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:06.288617 11488 heartbeater.cc:347] Connected to a master server at 127.8.149.126:43581
I20260808 08:47:06.288856 11488 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:06.288939 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11242
I20260808 08:47:06.289136 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:06.289636 8789 external_mini_cluster.cc:1428] Setting key 9cc2ea9a174cdfeb6649fac4925d330f
I20260808 08:47:06.289644 11488 heartbeater.cc:511] Master 127.8.149.126:43581 requested a full tablet report, sending...
I20260808 08:47:06.291263 10657 ts_manager.cc:194] Registered new tserver with Master: ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:06.292346 10657 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:37815
I20260808 08:47:06.293103 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:06.295868 11017 heartbeater.cc:503] Master 127.8.149.126:43581 was elected leader, sending a full tablet report...
Aug 08 08:47:06 dist-test-slave-7vjv krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:47:06 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:06.346385 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.329624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.8.149.126:43581)
0808 08:47:06.329823 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.329828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.330120 (+ 292us) server_negotiation.cc:407] Connection header received
0808 08:47:06.330285 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.330289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.330360 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.330461 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:06.332182 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.333031 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.334457 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.334932 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.335074 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.339204 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:06.339214 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:06.339220 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:06.339278 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:06.343176 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.344065 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.344083 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.344087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.344282 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:06.344775 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:06.344781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:06.344787 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:06.345175 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:06.345422 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.345738 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.345960 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:47:06.350837 10657 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:06.358301 10657 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:06.396894 11513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.370859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37618 (local address 127.8.149.66:45613)
0808 08:47:06.389066 (+ 18207us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.389076 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.389107 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:47:06.389202 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.389208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.389439 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.389628 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.390414 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.391983 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.394337 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.395695 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.395873 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.396117 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.396405 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.396575 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18026,"thread_start_us":17898,"threads_started":1}
I20260808 08:47:06.397002 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.370386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45613 (local address 127.0.0.1:37618)
0808 08:47:06.371134 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.371174 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.371358 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.389646 (+ 18288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.389653 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.389684 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.390159 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.390176 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.392155 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.392160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.394103 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.394115 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.395939 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.395947 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.396160 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.396215 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.396345 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.396556 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":3,"thread_start_us":1700,"threads_started":1}
I20260808 08:47:06.397593 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.373526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38524 (local address 127.8.149.65:34751)
0808 08:47:06.388658 (+ 15132us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.388668 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.388699 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:47:06.388811 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.388820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.389098 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.389335 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.390519 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.392007 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.394841 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.396000 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.396157 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.396370 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.397092 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.397264 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14943,"thread_start_us":14812,"threads_started":1}
I20260808 08:47:06.397961 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.370593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35495 (local address 127.0.0.1:41116)
0808 08:47:06.384896 (+ 14303us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.384922 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.385066 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.390801 (+ 5735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.390807 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.390834 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.391179 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.391189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.392973 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.392978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.395165 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.395178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.397211 (+ 2033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.397217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.397404 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.397439 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.397537 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.397653 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14111,"thread_start_us":13978,"threads_started":1}
I20260808 08:47:06.398082 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.370979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41116 (local address 127.8.149.67:35495)
0808 08:47:06.390341 (+ 19362us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.390351 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.390396 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:47:06.390485 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.390490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.390622 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.390798 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.391390 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.392821 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.395322 (+ 2501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.396720 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.396848 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.397076 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.397604 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.397765 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19158,"thread_start_us":18956,"threads_started":1}
I20260808 08:47:06.399226 11517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.372931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34751 (local address 127.0.0.1:38524)
0808 08:47:06.387212 (+ 14281us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.387226 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.387311 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.389659 (+ 2348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.389667 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.389701 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.390285 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.390296 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.392213 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.392217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.394638 (+ 2421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.394657 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.396507 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.396513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.396689 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.396723 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.396818 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.396957 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14157,"mutex_wait_us":62,"thread_start_us":14034,"threads_started":1}
I20260808 08:47:06.400753 11129 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (DEFAULT_TABLE table=test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.401695 11362 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (DEFAULT_TABLE table=test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.402273 11129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.403040 11362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.402629 10895 tablet_service.cc:1467] Processing CreateTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (DEFAULT_TABLE table=test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.403983 10895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.413578 11520 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Bootstrap starting.
I20260808 08:47:06.416882 11520 tablet_bootstrap.cc:654] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.417944 11520 log.cc:824] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:06.421315 11522 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Bootstrap starting.
I20260808 08:47:06.425177 11521 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Bootstrap starting.
I20260808 08:47:06.426440 11522 tablet_bootstrap.cc:654] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.427588 11522 log.cc:824] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:06.429280 11521 tablet_bootstrap.cc:654] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.430423 11522 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: No bootstrap required, opened a new log
I20260808 08:47:06.430539 11521 log.cc:824] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:06.430735 11522 ts_tablet_manager.cc:1397] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 08:47:06.430847 11520 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: No bootstrap required, opened a new log
I20260808 08:47:06.431151 11520 ts_tablet_manager.cc:1397] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.008s
I20260808 08:47:06.433574 11521 tablet_bootstrap.cc:492] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: No bootstrap required, opened a new log
I20260808 08:47:06.433861 11521 ts_tablet_manager.cc:1397] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:47:06.438467 11522 raft_consensus.cc:348] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.438815 11522 raft_consensus.cc:374] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.438947 11522 raft_consensus.cc:729] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 651b3759ab7d4344a221d7ed4b6c55df, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.439515 11522 consensus_queue.cc:260] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.441075 11522 ts_tablet_manager.cc:1428] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Time spent starting tablet: real 0.010s user 0.004s sys 0.007s
I20260808 08:47:06.442488 11520 raft_consensus.cc:348] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.442909 11520 raft_consensus.cc:374] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.443009 11520 raft_consensus.cc:729] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ecaed3e49f84fb6b0b51250c36a362a, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.443607 11520 consensus_queue.cc:260] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.443687 11521 raft_consensus.cc:348] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.444095 11521 raft_consensus.cc:374] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.444296 11521 raft_consensus.cc:729] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8432f6340a4f4584b4f9e3aa2e240f, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.445082 11520 ts_tablet_manager.cc:1428] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent starting tablet: real 0.014s user 0.010s sys 0.002s
I20260808 08:47:06.444972 11521 consensus_queue.cc:260] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.445429 11236 heartbeater.cc:503] Master 127.8.149.126:43581 was elected leader, sending a full tablet report...
I20260808 08:47:06.446144 11488 heartbeater.cc:503] Master 127.8.149.126:43581 was elected leader, sending a full tablet report...
I20260808 08:47:06.446911 11521 ts_tablet_manager.cc:1428] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 08:47:06.473806 11527 raft_consensus.cc:482] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:06.474046 11527 raft_consensus.cc:504] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.475636 11527 leader_election.cc:288] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66:45613), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:06.483150 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.476020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:40383 (local address 127.8.149.67:35495)
0808 08:47:06.476325 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.476334 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.477108 (+ 774us) server_negotiation.cc:407] Connection header received
0808 08:47:06.477319 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.477323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.477399 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.477492 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.478133 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.478825 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.481304 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.482072 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.482276 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.482412 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.482739 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.482859 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260808 08:47:06.483469 11513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.476158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:56225 (local address 127.8.149.66:45613)
0808 08:47:06.476402 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.476411 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.477149 (+ 738us) server_negotiation.cc:407] Connection header received
0808 08:47:06.477347 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.477351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.477418 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.477511 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.478195 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.478899 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.481317 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.482084 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.482301 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.482423 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.483025 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.483149 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:47:06.483608 11532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.475971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35495 (local address 127.8.149.65:40383)
0808 08:47:06.476993 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.477014 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.477174 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.477511 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.477515 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.477539 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.477977 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.477990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.478960 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.478966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.481147 (+ 2181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.481159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.482416 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.482425 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.482578 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.482602 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.482712 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.482832 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":32,"thread_start_us":687,"threads_started":1}
I20260808 08:47:06.484144 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.476010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45613 (local address 127.8.149.65:56225)
0808 08:47:06.477044 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.477059 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.477207 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.477526 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.477530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.477554 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.478009 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.478018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.479035 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.479041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.481166 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.481178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.482556 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.482565 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.482813 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.482860 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.483006 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.483129 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":3,"thread_start_us":691,"threads_started":1}
I20260808 08:47:06.484833 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb32cefa73845c3a9e8f9d19ff3b42f" candidate_uuid: "651b3759ab7d4344a221d7ed4b6c55df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" is_pre_election: true
I20260808 08:47:06.485294 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb32cefa73845c3a9e8f9d19ff3b42f" candidate_uuid: "651b3759ab7d4344a221d7ed4b6c55df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" is_pre_election: true
I20260808 08:47:06.485548 11403 raft_consensus.cc:2454] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 651b3759ab7d4344a221d7ed4b6c55df in term 0.
I20260808 08:47:06.485909 11159 raft_consensus.cc:2454] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 651b3759ab7d4344a221d7ed4b6c55df in term 0.
I20260808 08:47:06.486383 10814 leader_election.cc:302] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 651b3759ab7d4344a221d7ed4b6c55df, ac8432f6340a4f4584b4f9e3aa2e240f; no voters:
I20260808 08:47:06.486865 11527 raft_consensus.cc:2781] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:06.487102 11527 raft_consensus.cc:482] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:06.487300 11527 raft_consensus.cc:3037] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.490329 11527 raft_consensus.cc:504] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.491062 11527 leader_election.cc:288] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [CANDIDATE]: Term 1 election: Requested vote from peers 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66:45613), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:06.491606 11159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb32cefa73845c3a9e8f9d19ff3b42f" candidate_uuid: "651b3759ab7d4344a221d7ed4b6c55df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ecaed3e49f84fb6b0b51250c36a362a"
I20260808 08:47:06.491671 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cb32cefa73845c3a9e8f9d19ff3b42f" candidate_uuid: "651b3759ab7d4344a221d7ed4b6c55df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
I20260808 08:47:06.491832 11159 raft_consensus.cc:3037] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.491847 11403 raft_consensus.cc:3037] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.495929 11403 raft_consensus.cc:2454] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 651b3759ab7d4344a221d7ed4b6c55df in term 1.
I20260808 08:47:06.495935 11159 raft_consensus.cc:2454] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 651b3759ab7d4344a221d7ed4b6c55df in term 1.
I20260808 08:47:06.496336 10814 leader_election.cc:302] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 651b3759ab7d4344a221d7ed4b6c55df, ac8432f6340a4f4584b4f9e3aa2e240f; no voters:
I20260808 08:47:06.496654 11527 raft_consensus.cc:2781] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:06.497275 11527 raft_consensus.cc:686] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 1 LEADER]: Becoming Leader. State: Replica: 651b3759ab7d4344a221d7ed4b6c55df, State: Running, Role: LEADER
I20260808 08:47:06.497953 11527 consensus_queue.cc:237] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } }
I20260808 08:47:06.502868 10657 catalog_manager.cc:5495] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df reported cstate change: term changed from 0 to 1, leader changed from <none> to 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65). New cstate: current_term: 1 leader_uuid: "651b3759ab7d4344a221d7ed4b6c55df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } health_report { overall_health: HEALTHY } } }
W20260808 08:47:06.538383 11493 tablet.cc:2369] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:06.539418 11018 tablet.cc:2369] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:06.544549 11237 tablet.cc:2369] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:06.548032 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.541418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.8.149.65:34751)
0808 08:47:06.541592 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.541597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.541770 (+ 173us) server_negotiation.cc:407] Connection header received
0808 08:47:06.542058 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.542061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.542139 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.542250 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:06.542678 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.543535 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.545253 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.546182 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.546296 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.546888 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:06.547505 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:06.547626 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.547743 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.547815 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:47:06.560720 11403 raft_consensus.cc:1261] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Refusing update from remote peer 651b3759ab7d4344a221d7ed4b6c55df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:06.560901 11159 raft_consensus.cc:1261] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Refusing update from remote peer 651b3759ab7d4344a221d7ed4b6c55df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:06.562175 11527 consensus_queue.cc:1035] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:06.562566 11535 consensus_queue.cc:1035] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:06.574836 11538 mvcc.cc:205] Tried to move back new op lower bound from 7316188473569570816 to 7316188473339719680. Current Snapshot: MvccSnapshot[applied={T|T < 7316188473569570816}]
I20260808 08:47:06.582854 11542 mvcc.cc:205] Tried to move back new op lower bound from 7316188473569570816 to 7316188473339719680. Current Snapshot: MvccSnapshot[applied={T|T < 7316188473569570816}]
I20260808 08:47:06.603127 10656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:06.603572 10656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:06.608603 10656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Sending DeleteTablet for 3 replicas of tablet 2cb32cefa73845c3a9e8f9d19ff3b42f
I20260808 08:47:06.610296 11129 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:06 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:37618
I20260808 08:47:06.610298 11362 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:06 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:41116
I20260808 08:47:06.611948 10656 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:06.612638 10656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:06.613168 10895 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cb32cefa73845c3a9e8f9d19ff3b42f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:06 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:38524
I20260808 08:47:06.621987 11124 tablet_service.cc:1467] Processing CreateTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 (DEFAULT_TABLE table=test-table [id=62b82e3a8316412d96ab73e0d85c03f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.621858 10894 tablet_service.cc:1467] Processing CreateTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 (DEFAULT_TABLE table=test-table [id=62b82e3a8316412d96ab73e0d85c03f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.622263 11361 tablet_service.cc:1467] Processing CreateTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 (DEFAULT_TABLE table=test-table [id=62b82e3a8316412d96ab73e0d85c03f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:06.622761 11124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e0614dc737480d8e47ecdb4f5ece39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.622880 10894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e0614dc737480d8e47ecdb4f5ece39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.623188 11361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00e0614dc737480d8e47ecdb4f5ece39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:06.631971 11521 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Bootstrap starting.
I20260808 08:47:06.632217 11522 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Bootstrap starting.
I20260808 08:47:06.633715 11520 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Bootstrap starting.
I20260808 08:47:06.634763 11522 tablet_bootstrap.cc:654] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.635577 11521 tablet_bootstrap.cc:654] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.636574 11520 tablet_bootstrap.cc:654] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:06.646026 11552 tablet_replica.cc:330] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: stopping tablet replica
I20260808 08:47:06.646749 11552 raft_consensus.cc:2229] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:06.647549 11552 raft_consensus.cc:2258] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:06.649312 11554 tablet_replica.cc:330] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: stopping tablet replica
I20260808 08:47:06.649531 11520 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: No bootstrap required, opened a new log
I20260808 08:47:06.649760 11520 ts_tablet_manager.cc:1397] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.001s
I20260808 08:47:06.650195 11521 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: No bootstrap required, opened a new log
I20260808 08:47:06.650079 11522 tablet_bootstrap.cc:492] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: No bootstrap required, opened a new log
I20260808 08:47:06.650480 11522 ts_tablet_manager.cc:1397] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.009s
I20260808 08:47:06.650484 11521 ts_tablet_manager.cc:1397] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s
I20260808 08:47:06.651201 11520 raft_consensus.cc:348] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.651531 11520 raft_consensus.cc:374] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.651760 11520 raft_consensus.cc:729] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ecaed3e49f84fb6b0b51250c36a362a, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.651800 11552 ts_tablet_manager.cc:1905] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:06.651793 11522 raft_consensus.cc:348] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.652211 11520 consensus_queue.cc:260] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.653007 11520 ts_tablet_manager.cc:1428] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:06.652033 11522 raft_consensus.cc:374] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.653386 11522 raft_consensus.cc:729] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 651b3759ab7d4344a221d7ed4b6c55df, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.651870 11521 raft_consensus.cc:348] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.653882 11521 raft_consensus.cc:374] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:06.654053 11521 raft_consensus.cc:729] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8432f6340a4f4584b4f9e3aa2e240f, State: Initialized, Role: FOLLOWER
I20260808 08:47:06.654420 11521 consensus_queue.cc:260] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.655148 11554 raft_consensus.cc:2229] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:06.660034 11522 consensus_queue.cc:260] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.660897 11522 ts_tablet_manager.cc:1428] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260808 08:47:06.661319 11554 raft_consensus.cc:2258] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:06.661969 11521 ts_tablet_manager.cc:1428] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260808 08:47:06.662919 11553 tablet_replica.cc:330] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: stopping tablet replica
I20260808 08:47:06.664443 11553 raft_consensus.cc:2229] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:06.665020 11553 raft_consensus.cc:2258] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:06.665832 11552 ts_tablet_manager.cc:1918] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:06.666097 11552 log.cc:1196] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/2cb32cefa73845c3a9e8f9d19ff3b42f
I20260808 08:47:06.666795 11552 ts_tablet_manager.cc:1939] T 2cb32cefa73845c3a9e8f9d19ff3b42f P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting consensus metadata
I20260808 08:47:06.667595 11554 ts_tablet_manager.cc:1905] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:06.667696 11553 ts_tablet_manager.cc:1905] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:06.668928 10632 catalog_manager.cc:4841] TS ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495): tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (table test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]) successfully deleted
I20260808 08:47:06.674785 11554 ts_tablet_manager.cc:1918] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:06.675006 11554 log.cc:1196] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/2cb32cefa73845c3a9e8f9d19ff3b42f
I20260808 08:47:06.675262 11553 ts_tablet_manager.cc:1918] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:06.675555 11553 log.cc:1196] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/2cb32cefa73845c3a9e8f9d19ff3b42f
I20260808 08:47:06.675637 11554 ts_tablet_manager.cc:1939] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 651b3759ab7d4344a221d7ed4b6c55df: Deleting consensus metadata
I20260808 08:47:06.676110 11553 ts_tablet_manager.cc:1939] T 2cb32cefa73845c3a9e8f9d19ff3b42f P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting consensus metadata
I20260808 08:47:06.677347 10627 catalog_manager.cc:4841] TS 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751): tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (table test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]) successfully deleted
I20260808 08:47:06.677645 10631 catalog_manager.cc:4841] TS 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66:45613): tablet 2cb32cefa73845c3a9e8f9d19ff3b42f (table test-table [id=c613cf7f8f3e494c9e61344b5bd03f55]) successfully deleted
I20260808 08:47:06.941256 11528 raft_consensus.cc:482] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:06.941488 11528 raft_consensus.cc:504] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.943121 11528 leader_election.cc:288] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:06.951202 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.943641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:34481 (local address 127.8.149.65:34751)
0808 08:47:06.943877 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.943887 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.944535 (+ 648us) server_negotiation.cc:407] Connection header received
0808 08:47:06.944859 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.944863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.944930 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.945026 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.945629 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.946591 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.948620 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.949783 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.950007 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.950084 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.950551 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.950708 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:47:06.951215 11560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.943318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34751 (local address 127.8.149.66:34481)
0808 08:47:06.944411 (+ 1093us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.944434 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.944666 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.945048 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.945052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.945081 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.945454 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.945467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.946744 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.946749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.948465 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.948477 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.950080 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.950089 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.950331 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.950401 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.950516 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.950678 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":24,"thread_start_us":1227,"threads_started":1}
I20260808 08:47:06.952289 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.943972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:60441 (local address 127.8.149.67:35495)
0808 08:47:06.944196 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:06.944204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:06.945045 (+ 841us) server_negotiation.cc:407] Connection header received
0808 08:47:06.945363 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:06.945369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:06.945456 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:06.945555 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:06.946316 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.947321 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.949812 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.950993 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.951191 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.951276 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:06.951904 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 08:47:06.952026 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:47:06.952360 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:06.943504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35495 (local address 127.8.149.66:60441)
0808 08:47:06.944927 (+ 1423us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:06.944954 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:06.945180 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:06.945612 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:06.945618 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:06.945648 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:06.946125 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.946139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.947470 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.947476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.949637 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:06.949655 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:06.951501 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:06.951510 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:06.951705 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:06.951745 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:47:06.951868 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:47:06.951983 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1262,"mutex_wait_us":1,"thread_start_us":693,"threads_started":1}
I20260808 08:47:06.952550 10943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e0614dc737480d8e47ecdb4f5ece39" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "651b3759ab7d4344a221d7ed4b6c55df" is_pre_election: true
I20260808 08:47:06.953061 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e0614dc737480d8e47ecdb4f5ece39" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" is_pre_election: true
I20260808 08:47:06.953100 10943 raft_consensus.cc:2454] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 0.
I20260808 08:47:06.953310 11403 raft_consensus.cc:2454] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 0.
I20260808 08:47:06.953792 11054 leader_election.cc:302] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ecaed3e49f84fb6b0b51250c36a362a, ac8432f6340a4f4584b4f9e3aa2e240f; no voters:
I20260808 08:47:06.954171 11528 raft_consensus.cc:2781] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:06.954310 11528 raft_consensus.cc:482] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:06.954447 11528 raft_consensus.cc:3037] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.956787 11528 raft_consensus.cc:504] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.957361 11528 leader_election.cc:288] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 election: Requested vote from peers 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:06.957841 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e0614dc737480d8e47ecdb4f5ece39" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
I20260808 08:47:06.957863 10943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e0614dc737480d8e47ecdb4f5ece39" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "651b3759ab7d4344a221d7ed4b6c55df"
I20260808 08:47:06.958082 10943 raft_consensus.cc:3037] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.958076 11403 raft_consensus.cc:3037] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:06.961131 11403 raft_consensus.cc:2454] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 1.
I20260808 08:47:06.961519 11054 leader_election.cc:302] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ecaed3e49f84fb6b0b51250c36a362a, ac8432f6340a4f4584b4f9e3aa2e240f; no voters:
I20260808 08:47:06.961582 10943 raft_consensus.cc:2454] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 1.
I20260808 08:47:06.961831 11528 raft_consensus.cc:2781] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:06.962499 11528 raft_consensus.cc:686] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 LEADER]: Becoming Leader. State: Replica: 6ecaed3e49f84fb6b0b51250c36a362a, State: Running, Role: LEADER
I20260808 08:47:06.962899 11528 consensus_queue.cc:237] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:06.966799 10656 catalog_manager.cc:5495] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66). New cstate: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178824, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:07.048621 11577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.030681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35792 (local address 127.8.149.126:43581)
0808 08:47:07.032006 (+ 1325us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.032012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.032035 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:07.032084 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.032105 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.032174 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.032285 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.033871 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.035262 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.036716 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.037117 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.037246 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.042114 (+ 4868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.042119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.042122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.042150 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.044948 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.046145 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.046149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.046151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.046282 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.046869 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.046873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.046876 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.047118 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.047226 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.047866 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.048086 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1196,"thread_start_us":1050,"threads_started":1}
I20260808 08:47:07.048905 11576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.030586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:43581 (local address 127.0.0.1:35792)
0808 08:47:07.031750 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:07.031777 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:07.031970 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:07.032316 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:07.032321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:07.033356 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:07.033691 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.033701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.035383 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.035389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.036574 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.036586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.037287 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.037293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.037467 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.038224 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:07.038241 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:07.041842 (+ 3601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:07.045119 (+ 3277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:07.045133 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:07.045141 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:07.046009 (+ 868us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:07.046420 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:07.046426 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:07.046437 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:07.046760 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:07.047258 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:07.047278 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:07.047554 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 08:47:07.047786 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 08:47:07.048299 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"mutex_wait_us":139,"thread_start_us":729,"threads_started":1}
I20260808 08:47:07.054901 10656 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:35792:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:47:07.056531 10656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:07.064379 11129 tablet_service.cc:1467] Processing CreateTablet for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6bf63c6b55142d8b95e2a298a322e48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:07.064327 10895 tablet_service.cc:1467] Processing CreateTablet for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6bf63c6b55142d8b95e2a298a322e48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:07.064868 11129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:07.064739 11362 tablet_service.cc:1467] Processing CreateTablet for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6bf63c6b55142d8b95e2a298a322e48]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:07.065018 10895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:07.065394 11362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06bd1bf23f0b4e7a8bf4e1524ff467e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:07.070744 11520 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: Bootstrap starting.
I20260808 08:47:07.072309 11521 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: Bootstrap starting.
I20260808 08:47:07.072588 11522 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: Bootstrap starting.
I20260808 08:47:07.073848 11522 tablet_bootstrap.cc:654] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:07.073922 11521 tablet_bootstrap.cc:654] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:07.075172 11520 tablet_bootstrap.cc:654] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:07.077466 11521 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: No bootstrap required, opened a new log
I20260808 08:47:07.077626 11521 ts_tablet_manager.cc:1397] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 08:47:07.078334 11521 raft_consensus.cc:348] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.078573 11521 raft_consensus.cc:374] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:07.078651 11521 raft_consensus.cc:729] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8432f6340a4f4584b4f9e3aa2e240f, State: Initialized, Role: FOLLOWER
I20260808 08:47:07.078902 11521 consensus_queue.cc:260] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.079541 11521 ts_tablet_manager.cc:1428] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:47:07.080765 11520 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: No bootstrap required, opened a new log
I20260808 08:47:07.080929 11520 ts_tablet_manager.cc:1397] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260808 08:47:07.079550 11530 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.081159 11530 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.081761 11520 raft_consensus.cc:348] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.081997 11520 raft_consensus.cc:374] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:07.082074 11520 raft_consensus.cc:729] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ecaed3e49f84fb6b0b51250c36a362a, State: Initialized, Role: FOLLOWER
I20260808 08:47:07.082595 11520 consensus_queue.cc:260] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.083011 11528 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.083318 11528 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.083787 11520 ts_tablet_manager.cc:1428] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:07.089416 11522 tablet_bootstrap.cc:492] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: No bootstrap required, opened a new log
I20260808 08:47:07.089598 11522 ts_tablet_manager.cc:1397] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.011s
I20260808 08:47:07.090312 11522 raft_consensus.cc:348] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.090610 11522 raft_consensus.cc:374] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:07.090719 11522 raft_consensus.cc:729] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 651b3759ab7d4344a221d7ed4b6c55df, State: Initialized, Role: FOLLOWER
I20260808 08:47:07.090989 11522 consensus_queue.cc:260] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.091617 11522 ts_tablet_manager.cc:1428] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 08:47:07.091502 11527 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.091820 11527 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.143850 11528 raft_consensus.cc:482] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:07.144085 11528 raft_consensus.cc:504] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.144805 11528 leader_election.cc:288] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:07.145320 10943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bd1bf23f0b4e7a8bf4e1524ff467e7" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "651b3759ab7d4344a221d7ed4b6c55df" is_pre_election: true
I20260808 08:47:07.145452 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bd1bf23f0b4e7a8bf4e1524ff467e7" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" is_pre_election: true
I20260808 08:47:07.145610 10943 raft_consensus.cc:2454] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 0.
I20260808 08:47:07.145735 11403 raft_consensus.cc:2454] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 0.
I20260808 08:47:07.146126 11051 leader_election.cc:302] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 651b3759ab7d4344a221d7ed4b6c55df, 6ecaed3e49f84fb6b0b51250c36a362a; no voters:
I20260808 08:47:07.146448 11528 raft_consensus.cc:2781] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:07.146548 11528 raft_consensus.cc:482] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:07.146665 11528 raft_consensus.cc:3037] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:07.148857 11528 raft_consensus.cc:504] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.149709 11528 leader_election.cc:288] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 election: Requested vote from peers 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751), ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495)
I20260808 08:47:07.149809 10943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bd1bf23f0b4e7a8bf4e1524ff467e7" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "651b3759ab7d4344a221d7ed4b6c55df"
I20260808 08:47:07.150030 10943 raft_consensus.cc:3037] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:07.149981 11403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06bd1bf23f0b4e7a8bf4e1524ff467e7" candidate_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f"
I20260808 08:47:07.150195 11403 raft_consensus.cc:3037] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:07.152702 10943 raft_consensus.cc:2454] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 1.
I20260808 08:47:07.152777 11403 raft_consensus.cc:2454] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ecaed3e49f84fb6b0b51250c36a362a in term 1.
I20260808 08:47:07.153148 11051 leader_election.cc:302] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 651b3759ab7d4344a221d7ed4b6c55df, 6ecaed3e49f84fb6b0b51250c36a362a; no voters:
I20260808 08:47:07.153451 11528 raft_consensus.cc:2781] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:07.153625 11528 raft_consensus.cc:686] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 LEADER]: Becoming Leader. State: Replica: 6ecaed3e49f84fb6b0b51250c36a362a, State: Running, Role: LEADER
I20260808 08:47:07.153879 11528 consensus_queue.cc:237] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } }
I20260808 08:47:07.155762 11561 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: TxnStatusTablet state changed. Reason: New leader 6ecaed3e49f84fb6b0b51250c36a362a. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.156062 11561 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:07.156792 11586 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:47:07.157101 11586 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:47:07.157227 10657 catalog_manager.cc:5495] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66). New cstate: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:07.185138 11591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.178590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37620 (local address 127.8.149.66:45613)
0808 08:47:07.179055 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.179059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.179094 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:47:07.179413 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.179416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.179505 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.179633 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:07.180065 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.180865 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.182717 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.183243 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.183383 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.183907 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:07.184500 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:07.184622 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.184777 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.184844 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":243,"threads_started":1}
I20260808 08:47:07.185237 11576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.178653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45613 (local address 127.0.0.1:37620)
0808 08:47:07.179013 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:07.179034 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:07.179200 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:07.179690 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:07.179694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:07.179708 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:07.179915 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.179929 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.181002 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.181009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.182547 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.182563 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.183414 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.183420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.183637 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.183708 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:07.184625 (+ 917us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:07.184647 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:47:07.184741 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:47:07.184917 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260808 08:47:07.190032 11403 raft_consensus.cc:1261] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Refusing update from remote peer 6ecaed3e49f84fb6b0b51250c36a362a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:07.190459 10943 raft_consensus.cc:1261] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Refusing update from remote peer 6ecaed3e49f84fb6b0b51250c36a362a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:07.190732 11561 consensus_queue.cc:1035] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:07.191195 11528 consensus_queue.cc:1035] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Connected to new peer: Peer: permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:07.197876 11530 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: TxnStatusTablet state changed. Reason: New leader 6ecaed3e49f84fb6b0b51250c36a362a. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.198161 11530 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.200955 11593 mvcc.cc:205] Tried to move back new op lower bound from 7316188476162838528 to 7316188476024500224. Current Snapshot: MvccSnapshot[applied={T|T < 7316188476162838528}]
I20260808 08:47:07.201560 11561 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.202446 11561 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:07.205575 11527 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: TxnStatusTablet state changed. Reason: New leader 6ecaed3e49f84fb6b0b51250c36a362a. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.205890 11527 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.206852 11530 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.207103 11530 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P ac8432f6340a4f4584b4f9e3aa2e240f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.208114 11561 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.208348 11561 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 6ecaed3e49f84fb6b0b51250c36a362a: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:07.212440 11527 tablet_replica.cc:439] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 } } peers { permanent_uuid: "6ecaed3e49f84fb6b0b51250c36a362a" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45613 } } peers { permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 } } }
I20260808 08:47:07.212687 11527 tablet_replica.cc:442] T 06bd1bf23f0b4e7a8bf4e1524ff467e7 P 651b3759ab7d4344a221d7ed4b6c55df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:07.221407 11591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.215210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37632 (local address 127.8.149.66:45613)
0808 08:47:07.215440 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.215446 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.215910 (+ 464us) server_negotiation.cc:407] Connection header received
0808 08:47:07.216035 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.216040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.216148 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.216241 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:07.216691 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.217893 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.219427 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.220186 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.220328 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.220687 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:07.220808 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:07.220913 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.221038 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.221113 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:47:07.237826 11591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.231992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:38819 (local address 127.8.149.66:45613)
0808 08:47:07.232189 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.232192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.232854 (+ 662us) server_negotiation.cc:407] Connection header received
0808 08:47:07.233060 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.233063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.233141 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.233269 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:07.233784 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.234620 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.235988 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.236452 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.236599 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.237019 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:07.237100 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:07.237192 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.237328 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.237443 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":45}
I20260808 08:47:07.237900 11620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.232046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45613 (local address 127.8.149.66:38819)
0808 08:47:07.232736 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:07.232757 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:07.232902 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:07.233291 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:07.233295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:07.233307 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:07.233634 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.233642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.234727 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.234734 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.235842 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:07.235856 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.236666 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.236677 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:07.236779 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.236832 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:07.237193 (+ 361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:07.237205 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:47:07.237311 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:47:07.237481 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":17,"thread_start_us":409,"threads_started":1}
I20260808 08:47:07.247921 11403 raft_consensus.cc:1261] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Refusing update from remote peer 6ecaed3e49f84fb6b0b51250c36a362a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:07.248235 10943 raft_consensus.cc:1261] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Refusing update from remote peer 6ecaed3e49f84fb6b0b51250c36a362a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:07.248502 11621 consensus_queue.cc:1035] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac8432f6340a4f4584b4f9e3aa2e240f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:07.248834 11561 consensus_queue.cc:1035] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [LEADER]: Connected to new peer: Peer: permanent_uuid: "651b3759ab7d4344a221d7ed4b6c55df" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:07.314987 10657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:07.315243 10657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:07.318374 10657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d6e520b5501c4a69bfced9b9759c6858: Sending DeleteTablet for 3 replicas of tablet 00e0614dc737480d8e47ecdb4f5ece39
I20260808 08:47:07.319003 10895 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:07 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:38524
I20260808 08:47:07.319244 11362 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:07 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:41116
I20260808 08:47:07.319628 11129 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e0614dc737480d8e47ecdb4f5ece39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:07 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:37618
I20260808 08:47:07.349699 11632 tablet_replica.cc:330] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: stopping tablet replica
I20260808 08:47:07.349922 11632 raft_consensus.cc:2229] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:07.350631 11632 raft_consensus.cc:2258] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:07.351141 11630 tablet_replica.cc:330] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: stopping tablet replica
I20260808 08:47:07.351598 11631 tablet_replica.cc:330] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: stopping tablet replica
I20260808 08:47:07.352716 11632 ts_tablet_manager.cc:1905] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:07.352991 11630 raft_consensus.cc:2229] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:07.353253 11631 raft_consensus.cc:2229] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:07.353581 11630 raft_consensus.cc:2258] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:07.353883 11631 raft_consensus.cc:2258] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:07.355136 11630 ts_tablet_manager.cc:1905] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:07.359998 11631 ts_tablet_manager.cc:1905] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:07.369397 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.349503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38536 (local address 127.8.149.65:34751)
0808 08:47:07.349676 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.349684 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.350750 (+ 1066us) server_negotiation.cc:407] Connection header received
0808 08:47:07.351039 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.351044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.351131 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.351205 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.353204 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.354331 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.356217 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.356786 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.356867 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.362144 (+ 5277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.362159 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.362178 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.362220 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.366229 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.367094 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.367105 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.367110 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.367283 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.367660 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.367665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.367668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.368069 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.368327 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.368821 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.369013 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 08:47:07.370869 11005 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38536
I20260808 08:47:07.372411 11632 ts_tablet_manager.cc:1918] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:07.373481 11631 ts_tablet_manager.cc:1918] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:07.373716 11631 log.cc:1196] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/00e0614dc737480d8e47ecdb4f5ece39
I20260808 08:47:07.374390 11631 ts_tablet_manager.cc:1939] T 00e0614dc737480d8e47ecdb4f5ece39 P ac8432f6340a4f4584b4f9e3aa2e240f: Deleting consensus metadata
I20260808 08:47:07.375792 10632 catalog_manager.cc:4841] TS ac8432f6340a4f4584b4f9e3aa2e240f (127.8.149.67:35495): tablet 00e0614dc737480d8e47ecdb4f5ece39 (table test-table [id=62b82e3a8316412d96ab73e0d85c03f4]) successfully deleted
I20260808 08:47:07.377295 11630 ts_tablet_manager.cc:1918] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:07.377444 11630 log.cc:1196] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/00e0614dc737480d8e47ecdb4f5ece39
I20260808 08:47:07.377928 11630 ts_tablet_manager.cc:1939] T 00e0614dc737480d8e47ecdb4f5ece39 P 651b3759ab7d4344a221d7ed4b6c55df: Deleting consensus metadata
I20260808 08:47:07.378892 10627 catalog_manager.cc:4841] TS 651b3759ab7d4344a221d7ed4b6c55df (127.8.149.65:34751): tablet 00e0614dc737480d8e47ecdb4f5ece39 (table test-table [id=62b82e3a8316412d96ab73e0d85c03f4]) successfully deleted
I20260808 08:47:07.380270 11632 log.cc:1196] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/00e0614dc737480d8e47ecdb4f5ece39
I20260808 08:47:07.380921 11632 ts_tablet_manager.cc:1939] T 00e0614dc737480d8e47ecdb4f5ece39 P 6ecaed3e49f84fb6b0b51250c36a362a: Deleting consensus metadata
I20260808 08:47:07.382393 10631 catalog_manager.cc:4841] TS 6ecaed3e49f84fb6b0b51250c36a362a (127.8.149.66:45613): tablet 00e0614dc737480d8e47ecdb4f5ece39 (table test-table [id=62b82e3a8316412d96ab73e0d85c03f4]) successfully deleted
I20260808 08:47:07.396025 11577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.382186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35794 (local address 127.8.149.126:43581)
0808 08:47:07.382395 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.382400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.384573 (+ 2173us) server_negotiation.cc:407] Connection header received
0808 08:47:07.384763 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.384768 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.384855 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.384961 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.386205 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.386888 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.388164 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.388589 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.388725 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.390853 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.390857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.390860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.390887 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.393498 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.394129 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.394134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.394137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.394259 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.394619 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.394624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.394627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.394908 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.395173 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.395485 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.395729 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 08:47:07.396601 10657 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35794
I20260808 08:47:07.399206 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10788
I20260808 08:47:07.413542 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.400219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38542 (local address 127.8.149.65:34751)
0808 08:47:07.400381 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.400389 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.400472 (+ 83us) server_negotiation.cc:407] Connection header received
0808 08:47:07.400647 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.400653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.400725 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.400824 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.401907 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.403012 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.404334 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.405021 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.405149 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.407725 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.407732 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.407736 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.407792 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.410734 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.411314 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.411323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.411325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.411498 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.411881 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.411887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.411891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.412287 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.412594 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.412918 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.413128 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 08:47:07.414130 11005 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38542
W20260808 08:47:07.414760 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10788: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:07.415102 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10788
I20260808 08:47:07.450372 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11025
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:07.467463 11591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.451572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.8.149.66:45613)
0808 08:47:07.451786 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.451792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.451811 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:07.451870 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.451873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.451945 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.452023 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.453712 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.454392 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.456223 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.456658 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.456752 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.461499 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.461509 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.461523 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.461571 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.464598 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.465246 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.465255 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.465258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.465509 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.465907 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.465913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.465917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.466290 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.466627 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.466901 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.467132 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 08:47:07.468032 11229 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37642
W20260808 08:47:07.468755 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11025: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:07.468911 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11025
I20260808 08:47:07.495697 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11242
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178826, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:07.511168 11640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:07.496448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.8.149.67:35495)
0808 08:47:07.496981 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:07.496985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:07.497001 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:47:07.497054 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:07.497058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:07.497125 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:07.497213 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:07.498437 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.499195 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.500589 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:07.501095 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:07.501209 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:07.505528 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:07.505543 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:07.505560 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:07.505597 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:07.508610 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.509217 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.509224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.509226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.509356 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:07.509654 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:07.509657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:07.509659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:07.510127 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:07.510402 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:07.510543 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 08:47:07.510724 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":301,"threads_started":1}
W20260808 08:47:07.511948 11481 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41126
W20260808 08:47:07.512662 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11242: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:07.512785 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11242
I20260808 08:47:07.538569 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10596
I20260808 08:47:07.539597 10728 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:07.653549 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10596
2026-08-08T08:47:07Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4893 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[11645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[11645](info): set up 2 sockets
Aug 08 08:47:07 dist-test-slave-7vjv krb5kdc[11645](info): commencing operation
krb5kdc: starting...
W20260808 08:47:08.987653 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:09 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:09.175901 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39825
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:09.494117 11668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:09.494361 11668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:09.494513 11668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:09.501250 11668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:09.501332 11668 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:47:09.501417 11668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:09.501511 11668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:09.501588 11668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:09.501689 11668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:09.511044 11668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39825
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:09.512239 11668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:09.513458 11668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:09.525012 11679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:09.525218 11682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:09.525540 11678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:09.526005 11668 server_base.cc:1034] running on GCE node
I20260808 08:47:09.526726 11668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:09.528002 11668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:09.529322 11668 hybrid_clock.cc:648] HybridClock initialized: now 1786178829529232 us; error 37 us; skew 500 ppm
I20260808 08:47:09.529636 11668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:09 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178829, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:09.532807 11668 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:09.534057 11668 webserver.cc:460] Webserver started at http://127.8.149.126:44473/ using document root <none> and password file <none>
I20260808 08:47:09.534664 11668 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:09.534746 11668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:09.534993 11668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:09.537760 11668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "6be4373fe20543baaeb5a99806aff160"
format_stamp: "Formatted at 2026-08-08 08:47:09 on dist-test-slave-7vjv"
server_key: "2c0df37a4d746ab570e50f7ddfc6219a"
server_key_iv: "384d4a778d5c4544b5eaa80d208ec6bc"
server_key_version: "encryptionkey@0"
I20260808 08:47:09.538498 11668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "6be4373fe20543baaeb5a99806aff160"
format_stamp: "Formatted at 2026-08-08 08:47:09 on dist-test-slave-7vjv"
server_key: "2c0df37a4d746ab570e50f7ddfc6219a"
server_key_iv: "384d4a778d5c4544b5eaa80d208ec6bc"
server_key_version: "encryptionkey@0"
I20260808 08:47:09.543507 11668 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:47:09.546825 11692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:09.548061 11668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:47:09.548295 11668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "6be4373fe20543baaeb5a99806aff160"
format_stamp: "Formatted at 2026-08-08 08:47:09 on dist-test-slave-7vjv"
server_key: "2c0df37a4d746ab570e50f7ddfc6219a"
server_key_iv: "384d4a778d5c4544b5eaa80d208ec6bc"
server_key_version: "encryptionkey@0"
I20260808 08:47:09.548499 11668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:09.576074 11668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:09.580197 11668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:09.580466 11668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:09.602154 11668 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39825
I20260808 08:47:09.602174 11792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39825 every 8 connection(s)
I20260808 08:47:09.603328 11668 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:09.607142 11793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:09.612591 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11668
I20260808 08:47:09.612794 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:09.613502 8789 external_mini_cluster.cc:1428] Setting key 0627d950675e409f5acf2557f5ec0bb0
I20260808 08:47:09.618603 11793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Bootstrap starting.
I20260808 08:47:09.623142 11793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:09.624372 11793 log.cc:824] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:09.627280 11793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: No bootstrap required, opened a new log
Aug 08 08:47:09 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:09.635910 11793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } }
I20260808 08:47:09.636394 11793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:09.636543 11793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6be4373fe20543baaeb5a99806aff160, State: Initialized, Role: FOLLOWER
I20260808 08:47:09.636547 11796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:09.615474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40252 (local address 127.8.149.126:39825)
0808 08:47:09.616296 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:09.616307 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:09.616349 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:47:09.617943 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:09.617963 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:09.618318 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:09.618606 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:09.620806 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:09.622874 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:09.624378 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:09.625254 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:09.625447 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:09.629468 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:09.629476 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:09.629487 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:09.629517 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:09.632473 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:09.633110 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:09.633117 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:09.633122 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:09.633278 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:09.633749 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:09.633762 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:09.633764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:09.634293 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:09.634614 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:09.635061 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 08:47:09.635454 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":394,"threads_started":1}
I20260808 08:47:09.637287 11793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } }
I20260808 08:47:09.637565 11793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:09.637733 11793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:09.638016 11793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:09.640658 11793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } }
I20260808 08:47:09.641182 11793 leader_election.cc:302] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6be4373fe20543baaeb5a99806aff160; no voters:
I20260808 08:47:09.641726 11793 leader_election.cc:288] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:09.641877 11799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:09.642567 11799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [term 1 LEADER]: Becoming Leader. State: Replica: 6be4373fe20543baaeb5a99806aff160, State: Running, Role: LEADER
I20260808 08:47:09.643142 11799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } }
I20260808 08:47:09.643821 11793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:09.645975 11800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6be4373fe20543baaeb5a99806aff160" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } } }
I20260808 08:47:09.646255 11804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6be4373fe20543baaeb5a99806aff160. Latest consensus state: current_term: 1 leader_uuid: "6be4373fe20543baaeb5a99806aff160" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6be4373fe20543baaeb5a99806aff160" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39825 } } }
I20260808 08:47:09.646818 11800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:09.646852 11804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:09.649091 11809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:09.653657 11809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:09.663677 11809 catalog_manager.cc:1347] Generated new cluster ID: 298ebd7f0bf14bafb662f2788e65f39d
I20260808 08:47:09.663774 11809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:09.672508 11809 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:09.673856 11809 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:09.681229 11809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Generated new TSK 0
I20260808 08:47:09.682143 11809 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:09.747488 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39825
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:10.080861 11831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:10.081113 11831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:10.081207 11831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:10.087966 11831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:10.088056 11831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:10.088197 11831 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:47:10.088256 11831 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:10.088326 11831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:10.097052 11831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:39825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:10.098033 11831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:10.099124 11831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:10.111634 11845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:10.111716 11844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:10.111671 11848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:10.112569 11831 server_base.cc:1034] running on GCE node
I20260808 08:47:10.113166 11831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:10.114032 11831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:10.115293 11831 hybrid_clock.cc:648] HybridClock initialized: now 1786178830115250 us; error 62 us; skew 500 ppm
I20260808 08:47:10.115592 11831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:10 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178830, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:10.118638 11831 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:10.120234 11831 webserver.cc:460] Webserver started at http://127.8.149.65:40223/ using document root <none> and password file <none>
I20260808 08:47:10.120875 11831 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:10.120977 11831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:10.121243 11831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:10.123996 11831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "e28a43941513458528f3aab2a3989e95"
server_key_iv: "17523fbd1120600f79537ea5c5ad9ad1"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.124747 11831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "e28a43941513458528f3aab2a3989e95"
server_key_iv: "17523fbd1120600f79537ea5c5ad9ad1"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.129583 11831 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 08:47:10.132776 11859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:10.134007 11831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:10.134176 11831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "e28a43941513458528f3aab2a3989e95"
server_key_iv: "17523fbd1120600f79537ea5c5ad9ad1"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.134364 11831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:10.146842 11831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:10.150636 11831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:10.150915 11831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:10.153656 11831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:10.153810 11831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:10.153995 11831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:10.154158 11831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:47:10 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178830, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:10.178488 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.153952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:37941 (local address 127.8.149.126:39825)
0808 08:47:10.154453 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:10.154460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:10.155691 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 08:47:10.158329 (+ 2638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:10.158333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:10.158408 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:10.158496 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:10.161005 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.162001 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.165115 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.165604 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.165755 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.170205 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:10.170210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:10.170216 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:10.170281 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:10.173857 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.175113 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.175122 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.175128 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.175297 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.176011 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.176020 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.176026 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.176481 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:10.176663 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:10.177625 (+ 962us) server_negotiation.cc:299] Negotiation successful
0808 08:47:10.177924 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":235,"threads_started":1}
I20260808 08:47:10.178920 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.154538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.65:37941)
0808 08:47:10.155460 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:10.155512 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:10.158044 (+ 2532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:10.158778 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:10.158788 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:10.159690 (+ 902us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:10.160768 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.160805 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.162177 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.162187 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.164956 (+ 2769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.164973 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.166103 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.166109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.166333 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.167136 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:10.167193 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:10.169979 (+ 2786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:10.174066 (+ 4087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.174075 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.174096 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.174915 (+ 819us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.175472 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.175485 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.175490 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.175813 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.176640 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:10.176651 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:10.177108 (+ 457us) client_negotiation.cc:769] Sending connection context
0808 08:47:10.177473 (+ 365us) client_negotiation.cc:240] Negotiation successful
0808 08:47:10.177888 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":382,"threads_started":1}
I20260808 08:47:10.200434 11984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.184943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.65:59119)
0808 08:47:10.185667 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:10.185693 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:10.185851 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:10.186217 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:10.186226 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:10.186942 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:10.187398 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.187414 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.188413 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.188419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.190252 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.190265 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.190994 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.191002 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.191175 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.191803 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:10.191819 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:10.192804 (+ 985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:10.196762 (+ 3958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.196765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.196767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.197203 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.197758 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.197762 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.197769 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.197982 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.198820 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:10.198827 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:10.199063 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 08:47:10.199245 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 08:47:10.199712 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":343,"threads_started":1}
I20260808 08:47:10.200872 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.184790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:59119 (local address 127.8.149.126:39825)
0808 08:47:10.184965 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:10.184970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:10.185793 (+ 823us) server_negotiation.cc:407] Connection header received
0808 08:47:10.185964 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:10.185968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:10.186058 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:10.186155 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:10.187547 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.188266 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.190399 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.190802 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.190933 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.192998 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:10.193002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:10.193005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:10.193032 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:10.196639 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.197371 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.197380 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.197386 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.197576 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.198170 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.198177 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.198183 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.198569 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:10.198741 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:10.200288 (+ 1547us) server_negotiation.cc:299] Negotiation successful
0808 08:47:10.200500 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:47:10.207680 11831 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:45943
I20260808 08:47:10.207720 12046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:45943 every 8 connection(s)
I20260808 08:47:10.209012 11831 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:10.210888 12047 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39825
I20260808 08:47:10.211114 12047 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:10.211722 12047 heartbeater.cc:511] Master 127.8.149.126:39825 requested a full tablet report, sending...
I20260808 08:47:10.213577 11720 ts_manager.cc:194] Registered new tserver with Master: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943)
I20260808 08:47:10.214957 11720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:37941
I20260808 08:47:10.216881 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11831
I20260808 08:47:10.217087 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:10.217789 8789 external_mini_cluster.cc:1428] Setting key c8a069be3f396faf02d9809889b2b4bf
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:10.261176 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39825
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:10.576946 12052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:10.577188 12052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:10.577358 12052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:10.583768 12052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:10.583884 12052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:10.584043 12052 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:47:10.584141 12052 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:10.584265 12052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:10.593022 12052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:39825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:10.594100 12052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:10.595245 12052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:10.608520 12060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:10.609136 12059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:10.609418 12052 server_base.cc:1034] running on GCE node
W20260808 08:47:10.612591 12064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:10.613304 12052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:10.614347 12052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:10.615574 12052 hybrid_clock.cc:648] HybridClock initialized: now 1786178830615516 us; error 49 us; skew 500 ppm
I20260808 08:47:10.615904 12052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:10 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178830, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:10.621766 12052 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:10.623117 12052 webserver.cc:460] Webserver started at http://127.8.149.66:43723/ using document root <none> and password file <none>
I20260808 08:47:10.623942 12052 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:10.624125 12052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:10.624508 12052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:10.627938 12052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "588fdf8f52f346b5b1cf54fbd697b297"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "4beaa4493853edfe6c8c873aeef32fce"
server_key_iv: "d5bf5144d310744d95b2387b66afa12d"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.628705 12052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "588fdf8f52f346b5b1cf54fbd697b297"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "4beaa4493853edfe6c8c873aeef32fce"
server_key_iv: "d5bf5144d310744d95b2387b66afa12d"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.633546 12052 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:47:10.636823 12079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:10.638118 12052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:10.638278 12052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "588fdf8f52f346b5b1cf54fbd697b297"
format_stamp: "Formatted at 2026-08-08 08:47:10 on dist-test-slave-7vjv"
server_key: "4beaa4493853edfe6c8c873aeef32fce"
server_key_iv: "d5bf5144d310744d95b2387b66afa12d"
server_key_version: "encryptionkey@0"
I20260808 08:47:10.638465 12052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:10.650207 12052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:10.654345 12052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:10.654675 12052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:10.657564 12052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:10.657708 12052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:10.657850 12052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:10.657948 12052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:47:10 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178830, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:10.686057 12096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.658121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.66:48919)
0808 08:47:10.659028 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:10.659080 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:10.661820 (+ 2740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:10.662665 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:10.662686 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:10.663618 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:10.664747 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.664780 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.666067 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.666072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.668173 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.668215 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.669258 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.669269 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.669605 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.670379 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:10.670417 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:10.674595 (+ 4178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:10.679170 (+ 4575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.679179 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.679194 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.679700 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.680312 (+ 612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.680324 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.680329 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.680701 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.682221 (+ 1520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:10.682237 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:10.682804 (+ 567us) client_negotiation.cc:769] Sending connection context
0808 08:47:10.683322 (+ 518us) client_negotiation.cc:240] Negotiation successful
0808 08:47:10.684004 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":385,"threads_started":1}
I20260808 08:47:10.687529 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.657682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:48919 (local address 127.8.149.126:39825)
0808 08:47:10.657882 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:10.657890 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:10.659212 (+ 1322us) server_negotiation.cc:407] Connection header received
0808 08:47:10.662196 (+ 2984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:10.662203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:10.662290 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:10.662374 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:10.664980 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.665918 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.668418 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.669000 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.669140 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.674867 (+ 5727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:10.674874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:10.674881 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:10.674953 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:10.678985 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.679874 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.679884 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.679891 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.680119 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.680959 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.680965 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.680969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.681488 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:10.681670 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:10.686747 (+ 5077us) server_negotiation.cc:299] Negotiation successful
0808 08:47:10.687045 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:47:10.698585 12052 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:46809
I20260808 08:47:10.698629 12278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:46809 every 8 connection(s)
I20260808 08:47:10.699885 12052 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:10.702850 12280 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39825
I20260808 08:47:10.703126 12280 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:10.704044 12280 heartbeater.cc:511] Master 127.8.149.126:39825 requested a full tablet report, sending...
I20260808 08:47:10.705682 11720 ts_manager.cc:194] Registered new tserver with Master: 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809)
I20260808 08:47:10.706673 11720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:48919
I20260808 08:47:10.709189 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.695943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:55151 (local address 127.8.149.126:39825)
0808 08:47:10.696146 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:10.696152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:10.696439 (+ 287us) server_negotiation.cc:407] Connection header received
0808 08:47:10.696621 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:10.696626 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:10.696687 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:10.696779 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:10.697823 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.698818 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.700231 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.700613 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.700751 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.702890 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:10.702897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:10.702903 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:10.702946 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:10.706279 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.707103 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.707111 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.707116 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.707300 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:10.707693 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:10.707700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:10.707705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:10.708028 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:10.708241 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:10.708659 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 08:47:10.708863 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:47:10.709283 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:10.695631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.66:55151)
0808 08:47:10.696329 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:10.696344 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:10.696501 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:10.696802 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:10.696806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:10.697209 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:10.697623 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.697639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.698982 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.698986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.700023 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:10.700036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:10.700989 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:10.700999 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:10.701234 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:10.701895 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:10.701916 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:10.702651 (+ 735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:10.706414 (+ 3763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.706420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.706424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.706956 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.707430 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:10.707436 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:10.707440 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:10.707577 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:10.708192 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:10.708196 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:10.708396 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 08:47:10.708541 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 08:47:10.708853 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":490,"threads_started":1}
I20260808 08:47:10.709991 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12052
I20260808 08:47:10.710170 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:10.710716 8789 external_mini_cluster.cc:1428] Setting key 61c08e631279c7d446a6ad10c4d905e4
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:10.754822 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39825
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:11.072540 12287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:11.072832 12287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:11.073011 12287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:11.079733 12287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:11.079861 12287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:11.080016 12287 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:47:11.080125 12287 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:47:11.080307 12287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:11.089499 12287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:39825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:11.090749 12287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:11.092012 12287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:11.104694 12295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:11.104652 12296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:11.104648 12303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:11.105455 12287 server_base.cc:1034] running on GCE node
I20260808 08:47:11.106055 12287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:11.106949 12287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:11.108188 12287 hybrid_clock.cc:648] HybridClock initialized: now 1786178831108122 us; error 56 us; skew 500 ppm
I20260808 08:47:11.108501 12287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:11 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178831, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:11.111464 12287 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:11.112849 12287 webserver.cc:460] Webserver started at http://127.8.149.67:45635/ using document root <none> and password file <none>
I20260808 08:47:11.113471 12287 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:11.113611 12287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:11.113914 12287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:11.116544 12287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "1695128dfa14499995accf07a7f80c86"
format_stamp: "Formatted at 2026-08-08 08:47:11 on dist-test-slave-7vjv"
server_key: "c995f97b1e1dea9ab68090a348d81832"
server_key_iv: "85163930077ab778f8298cf2c8e389af"
server_key_version: "encryptionkey@0"
I20260808 08:47:11.117249 12287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "1695128dfa14499995accf07a7f80c86"
format_stamp: "Formatted at 2026-08-08 08:47:11 on dist-test-slave-7vjv"
server_key: "c995f97b1e1dea9ab68090a348d81832"
server_key_iv: "85163930077ab778f8298cf2c8e389af"
server_key_version: "encryptionkey@0"
I20260808 08:47:11.122040 12287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:47:11.125232 12315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:11.126431 12287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:47:11.126601 12287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "1695128dfa14499995accf07a7f80c86"
format_stamp: "Formatted at 2026-08-08 08:47:11 on dist-test-slave-7vjv"
server_key: "c995f97b1e1dea9ab68090a348d81832"
server_key_iv: "85163930077ab778f8298cf2c8e389af"
server_key_version: "encryptionkey@0"
I20260808 08:47:11.126793 12287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:11.139297 12287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:11.143181 12287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:11.143457 12287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:11.146317 12287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:11.146446 12287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:11.146569 12287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:11.146670 12287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:47:11 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178831, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:11.172348 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.146948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:40859 (local address 127.8.149.126:39825)
0808 08:47:11.147190 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.147198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.148555 (+ 1357us) server_negotiation.cc:407] Connection header received
0808 08:47:11.150592 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.150600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.150721 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.150845 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:11.153283 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.154472 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.157149 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.158003 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.158174 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.163487 (+ 5313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:11.163496 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:11.163503 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:11.163552 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:11.167777 (+ 4225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.169086 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.169094 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.169098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.169259 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.169809 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.169815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.169819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.170280 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:11.170465 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.171356 (+ 891us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.171710 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:47:11.172797 12331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.147460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.67:40859)
0808 08:47:11.148391 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.148430 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.150258 (+ 1828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.151104 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.151112 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.151995 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:11.153092 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.153130 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.154748 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.154756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.156986 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.156998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.158241 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.158246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.158411 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.159141 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:11.159190 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:11.163178 (+ 3988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:11.167950 (+ 4772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.167962 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.167984 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.168849 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.169369 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.169374 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.169378 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.169644 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.170448 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:11.170455 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:11.170787 (+ 332us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.171125 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.171535 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":398,"threads_started":1}
I20260808 08:47:11.194986 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.180413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.8.149.67:35055)
0808 08:47:11.181113 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.181140 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.181290 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.181702 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.181709 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.182309 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:11.182799 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.182816 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.184098 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.184124 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.185758 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.185770 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.186660 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.186666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.186807 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.187420 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:11.187436 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:11.188225 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:11.191887 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.191902 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.191906 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.192446 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.192890 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.192894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.192898 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.193058 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.193687 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:11.193691 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:11.193916 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.194120 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.194444 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":376,"threads_started":1}
I20260808 08:47:11.195859 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.180277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:35055 (local address 127.8.149.126:39825)
0808 08:47:11.180516 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.180525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.181231 (+ 706us) server_negotiation.cc:407] Connection header received
0808 08:47:11.181421 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.181430 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.181537 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.181654 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:11.183007 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.183881 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.185923 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.186494 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.186621 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.188485 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:11.188491 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:11.188496 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:11.188535 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:11.191768 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.192560 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.192566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.192569 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.192724 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.193183 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.193188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.193191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.193580 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:11.193725 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.195298 (+ 1573us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.195490 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:47:11.196834 12287 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46351
I20260808 08:47:11.196893 12521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46351 every 8 connection(s)
I20260808 08:47:11.198553 12287 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:11.201001 12522 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39825
I20260808 08:47:11.201285 12522 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:11.201750 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12287
I20260808 08:47:11.201960 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:11.201967 12522 heartbeater.cc:511] Master 127.8.149.126:39825 requested a full tablet report, sending...
I20260808 08:47:11.202513 8789 external_mini_cluster.cc:1428] Setting key e3bfd3513437c0b09caaba8962f23218
I20260808 08:47:11.204025 11718 ts_manager.cc:194] Registered new tserver with Master: 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:11.205394 11718 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:40859
I20260808 08:47:11.205971 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:11.217726 12047 heartbeater.cc:503] Master 127.8.149.126:39825 was elected leader, sending a full tablet report...
Aug 08 08:47:11 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:47:11 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:11.257824 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.244258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.8.149.126:39825)
0808 08:47:11.244420 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.244425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.244745 (+ 320us) server_negotiation.cc:407] Connection header received
0808 08:47:11.244894 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.244899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.244972 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.245060 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:11.246416 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.247142 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.248348 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.248756 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.248850 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.252545 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:11.252551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:11.252556 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:11.252596 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:11.255090 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.255751 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.255755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.255758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.255899 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.256356 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.256361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.256364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.256646 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:11.256903 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.257239 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.257480 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:47:11.261818 11718 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:11.268728 11718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:11.293274 12541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.280178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:45943 (local address 127.0.0.1:53208)
0808 08:47:11.281715 (+ 1537us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.281775 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.281973 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.283229 (+ 1256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.283240 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.283287 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:11.283782 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.283798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.286303 (+ 2505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.286311 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.289304 (+ 2993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.289324 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.291995 (+ 2671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.292003 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.292331 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.292402 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.292576 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.292826 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"thread_start_us":1021,"threads_started":1}
I20260808 08:47:11.294201 12544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.280457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.8.149.65:45943)
0808 08:47:11.281171 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.281181 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.282282 (+ 1101us) server_negotiation.cc:407] Connection header received
0808 08:47:11.282411 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.282421 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.282728 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.282928 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:11.284030 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.286102 (+ 2072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.289523 (+ 3421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.291436 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.291603 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.291845 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.293679 (+ 1834us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.293903 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":413,"threads_started":1}
I20260808 08:47:11.298719 11937 tablet_service.cc:1467] Processing CreateTablet for tablet f43be5fe851149a7a43e51843f95ebbc (DEFAULT_TABLE table=test-table [id=af4a80c70c5b4560878b6638e0c69aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:11.300098 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43be5fe851149a7a43e51843f95ebbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.302119 12547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.282653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.8.149.66:46809)
0808 08:47:11.294574 (+ 11921us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.294585 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.294963 (+ 378us) server_negotiation.cc:407] Connection header received
0808 08:47:11.295068 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.295078 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.295326 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.295522 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:11.295915 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.297370 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.300327 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.301168 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.301316 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.301519 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.301692 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.301844 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11734,"thread_start_us":11598,"threads_started":1}
I20260808 08:47:11.302134 12541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.282062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:46809 (local address 127.0.0.1:55022)
0808 08:47:11.294586 (+ 12524us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.294603 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.294708 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.295529 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.295536 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.295562 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:11.295760 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.295773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.297545 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.297550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.300200 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.300214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.301326 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.301331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.301516 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.301556 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.301645 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.301769 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12411,"mutex_wait_us":4,"thread_start_us":12707,"threads_started":1}
I20260808 08:47:11.303247 12542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.280298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46351 (local address 127.0.0.1:47360)
0808 08:47:11.293330 (+ 13032us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.293349 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.293465 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.295060 (+ 1595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.295067 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.295097 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:11.295454 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.295468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.297108 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.297115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.299849 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.299862 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.302489 (+ 2627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.302513 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.302672 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.302705 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.302792 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.302903 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12912,"mutex_wait_us":766,"thread_start_us":13222,"threads_started":1}
I20260808 08:47:11.303714 12545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.281077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47360 (local address 127.8.149.67:46351)
0808 08:47:11.294276 (+ 13199us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.294286 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.294325 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:47:11.294412 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.294420 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.294641 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.294822 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:11.295677 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.296989 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.300003 (+ 3014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.301429 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.301555 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.301758 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.303235 (+ 1477us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.303390 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13019,"thread_start_us":12833,"threads_started":1}
I20260808 08:47:11.305418 12161 tablet_service.cc:1467] Processing CreateTablet for tablet f43be5fe851149a7a43e51843f95ebbc (DEFAULT_TABLE table=test-table [id=af4a80c70c5b4560878b6638e0c69aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:11.306751 12161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43be5fe851149a7a43e51843f95ebbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.307021 12403 tablet_service.cc:1467] Processing CreateTablet for tablet f43be5fe851149a7a43e51843f95ebbc (DEFAULT_TABLE table=test-table [id=af4a80c70c5b4560878b6638e0c69aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:11.308816 12403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43be5fe851149a7a43e51843f95ebbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.312882 12548 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Bootstrap starting.
I20260808 08:47:11.315884 12548 tablet_bootstrap.cc:654] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.317169 12548 log.cc:824] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:11.319504 12548 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: No bootstrap required, opened a new log
I20260808 08:47:11.319778 12548 ts_tablet_manager.cc:1397] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:47:11.320741 12551 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Bootstrap starting.
I20260808 08:47:11.322507 12552 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Bootstrap starting.
I20260808 08:47:11.324569 12551 tablet_bootstrap.cc:654] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.325642 12552 tablet_bootstrap.cc:654] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.325819 12551 log.cc:824] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:11.326785 12552 log.cc:824] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:11.328801 12551 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: No bootstrap required, opened a new log
I20260808 08:47:11.329062 12551 ts_tablet_manager.cc:1397] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260808 08:47:11.329464 12552 tablet_bootstrap.cc:492] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: No bootstrap required, opened a new log
I20260808 08:47:11.329780 12552 ts_tablet_manager.cc:1397] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260808 08:47:11.330263 12548 raft_consensus.cc:348] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.330690 12548 raft_consensus.cc:374] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.330788 12548 raft_consensus.cc:729] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.331384 12548 consensus_queue.cc:260] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.333343 12548 ts_tablet_manager.cc:1428] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 08:47:11.338812 12551 raft_consensus.cc:348] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.339169 12551 raft_consensus.cc:374] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.339283 12551 raft_consensus.cc:729] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.339856 12551 consensus_queue.cc:260] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.340939 12280 heartbeater.cc:503] Master 127.8.149.126:39825 was elected leader, sending a full tablet report...
I20260808 08:47:11.341593 12551 ts_tablet_manager.cc:1428] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 08:47:11.341409 12552 raft_consensus.cc:348] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.341820 12552 raft_consensus.cc:374] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.341919 12552 raft_consensus.cc:729] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1695128dfa14499995accf07a7f80c86, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.342484 12552 consensus_queue.cc:260] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.343605 12522 heartbeater.cc:503] Master 127.8.149.126:39825 was elected leader, sending a full tablet report...
I20260808 08:47:11.344250 12552 ts_tablet_manager.cc:1428] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
W20260808 08:47:11.450634 12523 tablet.cc:2369] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:11.452688 12283 tablet.cc:2369] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:11.461205 12048 tablet.cc:2369] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:11.637619 12564 raft_consensus.cc:482] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:11.637913 12564 raft_consensus.cc:504] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.639810 12564 leader_election.cc:288] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:11.646376 12544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.640073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:51107 (local address 127.8.149.65:45943)
0808 08:47:11.640309 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.640315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.640919 (+ 604us) server_negotiation.cc:407] Connection header received
0808 08:47:11.641203 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.641207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.641278 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.641374 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:11.641931 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.642696 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.644550 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.645469 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.645656 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.645731 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.646016 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.646136 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:47:11.646464 12568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.640002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:45943 (local address 127.8.149.66:51107)
0808 08:47:11.640795 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.640818 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.641013 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.641395 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.641399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.641433 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:11.641769 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.641780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.642820 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.642827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.644390 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.644402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.645685 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.645691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.645856 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.645879 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.645993 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.646121 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":446,"threads_started":1}
I20260808 08:47:11.646896 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.640310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46351 (local address 127.8.149.66:48049)
0808 08:47:11.641238 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.641252 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.641403 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.641771 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.641775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.641798 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:11.642238 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.642252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.643233 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.643238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.644761 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.644773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.646009 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.646015 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.646156 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.646178 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.646284 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.646406 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":3,"thread_start_us":556,"threads_started":1}
I20260808 08:47:11.647032 12545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.640604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:48049 (local address 127.8.149.67:46351)
0808 08:47:11.640784 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.640789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.641337 (+ 548us) server_negotiation.cc:407] Connection header received
0808 08:47:11.641557 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.641565 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.641642 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.641740 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:11.642389 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.643099 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.644919 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.645761 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.645948 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.646025 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.646307 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.646424 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:47:11.647634 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43be5fe851149a7a43e51843f95ebbc" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" is_pre_election: true
I20260808 08:47:11.648034 12436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43be5fe851149a7a43e51843f95ebbc" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86" is_pre_election: true
I20260808 08:47:11.648161 11974 raft_consensus.cc:2454] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:11.648506 12436 raft_consensus.cc:2454] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:11.648854 12085 leader_election.cc:302] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:11.649227 12564 raft_consensus.cc:2781] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:11.649370 12564 raft_consensus.cc:482] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:11.649489 12564 raft_consensus.cc:3037] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.651587 12564 raft_consensus.cc:504] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.652257 12564 leader_election.cc:288] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Requested vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:11.652603 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43be5fe851149a7a43e51843f95ebbc" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
I20260808 08:47:11.652761 12436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43be5fe851149a7a43e51843f95ebbc" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86"
I20260808 08:47:11.652789 11974 raft_consensus.cc:3037] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.652954 12436 raft_consensus.cc:3037] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.655341 12436 raft_consensus.cc:2454] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:11.655328 11974 raft_consensus.cc:2454] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:11.655687 12085 leader_election.cc:302] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:11.655947 12564 raft_consensus.cc:2781] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:11.656437 12564 raft_consensus.cc:686] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Becoming Leader. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Running, Role: LEADER
I20260808 08:47:11.656886 12564 consensus_queue.cc:237] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } }
I20260808 08:47:11.661144 11718 catalog_manager.cc:5495] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } health_report { overall_health: HEALTHY } } }
Aug 08 08:47:11 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178829, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:11.791579 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.778282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39825 (local address 127.0.0.1:40268)
0808 08:47:11.779076 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.779089 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.779199 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.779519 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.779522 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.780238 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:11.780489 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.780498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.781726 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.781730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.782806 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.782817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.783444 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.783451 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.783565 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.784235 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:11.784251 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:11.786429 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:11.789510 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.789519 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.789524 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.789873 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.790258 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:11.790263 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:11.790266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:11.790407 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:11.790860 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:11.790865 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:11.791003 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.791123 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.791275 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":602,"threads_started":1}
I20260808 08:47:11.791729 12583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.778242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.8.149.126:39825)
0808 08:47:11.778754 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.778758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.779168 (+ 410us) server_negotiation.cc:407] Connection header received
0808 08:47:11.779307 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.779311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.779368 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.779475 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:11.780643 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.781599 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.782923 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.783289 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.783383 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.786681 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:11.786686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:11.786690 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:11.786722 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:11.789401 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.789976 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.789981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.789983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.790112 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:11.790502 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:11.790505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:11.790507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:11.790755 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:11.790876 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.791221 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.791390 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":272,"threads_started":1}
I20260808 08:47:11.796852 11718 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:40268:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:47:11.797912 11718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:11.804456 12161 tablet_service.cc:1467] Processing CreateTablet for tablet bb03dd33d9764f76941c03f0c24bc3cb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1028afbd551a4cefa16eb03857abc82a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:11.804334 11937 tablet_service.cc:1467] Processing CreateTablet for tablet bb03dd33d9764f76941c03f0c24bc3cb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1028afbd551a4cefa16eb03857abc82a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:11.804693 12403 tablet_service.cc:1467] Processing CreateTablet for tablet bb03dd33d9764f76941c03f0c24bc3cb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1028afbd551a4cefa16eb03857abc82a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:47:11.805267 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb03dd33d9764f76941c03f0c24bc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.805267 12161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb03dd33d9764f76941c03f0c24bc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.805500 12403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb03dd33d9764f76941c03f0c24bc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:11.810932 12552 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: Bootstrap starting.
I20260808 08:47:11.812121 12548 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Bootstrap starting.
I20260808 08:47:11.812168 12551 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: Bootstrap starting.
I20260808 08:47:11.812348 12552 tablet_bootstrap.cc:654] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.813712 12551 tablet_bootstrap.cc:654] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.813795 12548 tablet_bootstrap.cc:654] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:11.814702 12552 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: No bootstrap required, opened a new log
I20260808 08:47:11.814914 12552 ts_tablet_manager.cc:1397] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:47:11.815902 12551 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: No bootstrap required, opened a new log
I20260808 08:47:11.815789 12552 raft_consensus.cc:348] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.816004 12552 raft_consensus.cc:374] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.816043 12551 ts_tablet_manager.cc:1397] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:47:11.816143 12552 raft_consensus.cc:729] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1695128dfa14499995accf07a7f80c86, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.816253 12548 tablet_bootstrap.cc:492] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: No bootstrap required, opened a new log
I20260808 08:47:11.816431 12548 ts_tablet_manager.cc:1397] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260808 08:47:11.816382 12552 consensus_queue.cc:260] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.816987 12552 ts_tablet_manager.cc:1428] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 08:47:11.816885 12551 raft_consensus.cc:348] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.816839 12566 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.817085 12551 raft_consensus.cc:374] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.817153 12566 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.817188 12551 raft_consensus.cc:729] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.817148 12548 raft_consensus.cc:348] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.817425 12551 consensus_queue.cc:260] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.817603 12548 raft_consensus.cc:374] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:11.817701 12548 raft_consensus.cc:729] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Initialized, Role: FOLLOWER
I20260808 08:47:11.818028 12551 ts_tablet_manager.cc:1428] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 08:47:11.817958 12548 consensus_queue.cc:260] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.818555 12548 ts_tablet_manager.cc:1428] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:47:11.818404 12563 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.818763 12563 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.818745 12564 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.819011 12564 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.874913 12564 raft_consensus.cc:482] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:11.875137 12564 raft_consensus.cc:504] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.875834 12564 leader_election.cc:288] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:11.876364 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb03dd33d9764f76941c03f0c24bc3cb" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" is_pre_election: true
I20260808 08:47:11.876443 12436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb03dd33d9764f76941c03f0c24bc3cb" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86" is_pre_election: true
I20260808 08:47:11.876665 12436 raft_consensus.cc:2454] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:11.876667 11974 raft_consensus.cc:2454] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:11.877108 12085 leader_election.cc:302] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:11.877430 12564 raft_consensus.cc:2781] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:11.877516 12564 raft_consensus.cc:482] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:11.877669 12564 raft_consensus.cc:3037] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.879693 12564 raft_consensus.cc:504] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.880201 12564 leader_election.cc:288] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Requested vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:11.880636 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb03dd33d9764f76941c03f0c24bc3cb" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
I20260808 08:47:11.880654 12436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb03dd33d9764f76941c03f0c24bc3cb" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86"
I20260808 08:47:11.880848 11974 raft_consensus.cc:3037] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.880983 12436 raft_consensus.cc:3037] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:11.882932 11974 raft_consensus.cc:2454] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:11.883116 12436 raft_consensus.cc:2454] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:11.883306 12085 leader_election.cc:302] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:11.883586 12564 raft_consensus.cc:2781] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:11.883781 12564 raft_consensus.cc:686] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Becoming Leader. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Running, Role: LEADER
I20260808 08:47:11.884123 12564 consensus_queue.cc:237] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:11.885701 12571 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: TxnStatusTablet state changed. Reason: New leader 588fdf8f52f346b5b1cf54fbd697b297. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.885942 12571 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:11.887042 11718 catalog_manager.cc:5495] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:11.900373 12592 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:47:11.900692 12592 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:47:11.918063 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.912085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:46809 (local address 127.0.0.1:55024)
0808 08:47:11.912339 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.912381 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.912531 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.913177 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.913182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.913198 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:11.913407 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.913417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.914582 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.914588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.915519 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.915531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.916337 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.916343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.916519 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.916570 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:11.917444 (+ 874us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:11.917466 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.917584 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.917736 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 08:47:11.918097 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.912221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55024 (local address 127.8.149.66:46809)
0808 08:47:11.912805 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.912809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.912833 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:47:11.912911 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.912914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.912980 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.913151 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:11.913584 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.914449 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.915661 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.916190 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.916328 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.916803 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:11.917319 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:11.917469 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.917605 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.917686 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":289,"threads_started":1}
I20260808 08:47:11.925607 11974 raft_consensus.cc:1261] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:11.925631 12436 raft_consensus.cc:1261] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:11.926574 12571 consensus_queue.cc:1035] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:11.926918 12564 consensus_queue.cc:1035] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:11.940119 12566 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: TxnStatusTablet state changed. Reason: New leader 588fdf8f52f346b5b1cf54fbd697b297. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.940459 12566 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.943089 12598 mvcc.cc:205] Tried to move back new op lower bound from 7316188495556902912 to 7316188495400071168. Current Snapshot: MvccSnapshot[applied={T|T < 7316188495556902912}]
I20260808 08:47:11.943764 12571 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.944031 12571 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:11.945572 12563 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: TxnStatusTablet state changed. Reason: New leader 588fdf8f52f346b5b1cf54fbd697b297. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.945914 12563 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.947367 12571 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.947628 12571 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 588fdf8f52f346b5b1cf54fbd697b297: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:47:11.948688 12566 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.948895 12566 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 1695128dfa14499995accf07a7f80c86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.952131 12563 tablet_replica.cc:439] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } } }
I20260808 08:47:11.952455 12563 tablet_replica.cc:442] T bb03dd33d9764f76941c03f0c24bc3cb P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:47:11.964011 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.957540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55032 (local address 127.8.149.66:46809)
0808 08:47:11.957790 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.957809 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.958280 (+ 471us) server_negotiation.cc:407] Connection header received
0808 08:47:11.958543 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.958547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.958608 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.958682 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:11.959204 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.959963 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.962097 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.962768 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.962871 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.963336 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:11.963440 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:11.963513 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.963679 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.963742 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:47:11.981072 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.974831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:54243 (local address 127.8.149.66:46809)
0808 08:47:11.975052 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:11.975062 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:11.975406 (+ 344us) server_negotiation.cc:407] Connection header received
0808 08:47:11.975547 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:11.975554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:11.975633 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:11.975729 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:11.976327 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.977461 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.978891 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.979586 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.979729 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.980355 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:11.980467 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:11.980576 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:11.980706 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 08:47:11.980762 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:47:11.981148 12625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:11.974530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:46809 (local address 127.8.149.66:54243)
0808 08:47:11.975294 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:11.975313 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:11.975430 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:11.975782 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:11.975787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:11.975804 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:11.976159 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.976169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.977602 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.977606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.978748 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:11.978759 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:11.979802 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:11.979807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:11.979999 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:11.980056 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:11.980574 (+ 518us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:11.980584 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:47:11.980683 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:47:11.980793 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":363,"threads_started":1}
I20260808 08:47:11.991554 11974 raft_consensus.cc:1261] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:11.991726 12436 raft_consensus.cc:1261] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:11.992278 12571 consensus_queue.cc:1035] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:11.992746 12571 consensus_queue.cc:1035] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:12.006902 12600 mvcc.cc:205] Tried to move back new op lower bound from 7316188495831871488 to 7316188494470103040. Current Snapshot: MvccSnapshot[applied={T|T < 7316188495831871488}]
I20260808 08:47:12.010500 12604 mvcc.cc:205] Tried to move back new op lower bound from 7316188495831871488 to 7316188494470103040. Current Snapshot: MvccSnapshot[applied={T|T < 7316188495831871488}]
I20260808 08:47:12.078249 11720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:12.078580 11720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:12.081936 11720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Sending DeleteTablet for 3 replicas of tablet f43be5fe851149a7a43e51843f95ebbc
I20260808 08:47:12.082966 11937 tablet_service.cc:1514] Processing DeleteTablet for tablet f43be5fe851149a7a43e51843f95ebbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:12 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:53208
I20260808 08:47:12.083101 12403 tablet_service.cc:1514] Processing DeleteTablet for tablet f43be5fe851149a7a43e51843f95ebbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:12 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:47360
I20260808 08:47:12.083518 12160 tablet_service.cc:1514] Processing DeleteTablet for tablet f43be5fe851149a7a43e51843f95ebbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:12 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:55022
I20260808 08:47:12.085570 11720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:12.086740 11720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:12.092993 12639 tablet_replica.cc:330] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: stopping tablet replica
I20260808 08:47:12.093715 12639 raft_consensus.cc:2229] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:12.094610 12639 raft_consensus.cc:2258] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:12.095255 12401 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 (DEFAULT_TABLE table=test-table [id=4cf75fa484044c53a3ac6054a5a282ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:12.095587 12638 tablet_replica.cc:330] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: stopping tablet replica
I20260808 08:47:12.095968 12401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9cd8251da04c8fa0d790ebb9a57602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:12.096076 12638 raft_consensus.cc:2229] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:12.096482 12638 raft_consensus.cc:2258] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:12.096804 12639 ts_tablet_manager.cc:1905] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:12.097224 12637 tablet_replica.cc:330] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: stopping tablet replica
I20260808 08:47:12.097590 12637 raft_consensus.cc:2229] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:12.097983 12637 raft_consensus.cc:2258] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:12.099743 12160 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 (DEFAULT_TABLE table=test-table [id=4cf75fa484044c53a3ac6054a5a282ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:12.100277 12160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9cd8251da04c8fa0d790ebb9a57602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:12.101085 11937 tablet_service.cc:1467] Processing CreateTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 (DEFAULT_TABLE table=test-table [id=4cf75fa484044c53a3ac6054a5a282ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:12.101505 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f9cd8251da04c8fa0d790ebb9a57602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:12.102825 12552 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Bootstrap starting.
I20260808 08:47:12.104486 12552 tablet_bootstrap.cc:654] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:12.107115 12551 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Bootstrap starting.
I20260808 08:47:12.108902 12551 tablet_bootstrap.cc:654] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:12.109870 12638 ts_tablet_manager.cc:1905] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:12.116525 12639 ts_tablet_manager.cc:1918] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:12.117925 12638 ts_tablet_manager.cc:1918] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:12.118098 12638 log.cc:1196] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/f43be5fe851149a7a43e51843f95ebbc
I20260808 08:47:12.118847 12638 ts_tablet_manager.cc:1939] T f43be5fe851149a7a43e51843f95ebbc P 1695128dfa14499995accf07a7f80c86: Deleting consensus metadata
I20260808 08:47:12.120630 12552 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: No bootstrap required, opened a new log
I20260808 08:47:12.120872 12552 ts_tablet_manager.cc:1397] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.005s
I20260808 08:47:12.121505 12637 ts_tablet_manager.cc:1905] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:12.121754 12552 raft_consensus.cc:348] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.122068 12552 raft_consensus.cc:374] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:12.122100 12639 log.cc:1196] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/f43be5fe851149a7a43e51843f95ebbc
I20260808 08:47:12.122188 12552 raft_consensus.cc:729] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1695128dfa14499995accf07a7f80c86, State: Initialized, Role: FOLLOWER
I20260808 08:47:12.122531 12552 consensus_queue.cc:260] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.122988 12639 ts_tablet_manager.cc:1939] T f43be5fe851149a7a43e51843f95ebbc P 588fdf8f52f346b5b1cf54fbd697b297: Deleting consensus metadata
I20260808 08:47:12.126041 11701 catalog_manager.cc:4841] TS 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809): tablet f43be5fe851149a7a43e51843f95ebbc (table test-table [id=af4a80c70c5b4560878b6638e0c69aca]) successfully deleted
I20260808 08:47:12.126147 12552 ts_tablet_manager.cc:1428] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260808 08:47:12.127043 12548 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Bootstrap starting.
I20260808 08:47:12.128952 12548 tablet_bootstrap.cc:654] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:12.129683 12637 ts_tablet_manager.cc:1918] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:12.129822 12637 log.cc:1196] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/f43be5fe851149a7a43e51843f95ebbc
I20260808 08:47:12.130998 12637 ts_tablet_manager.cc:1939] T f43be5fe851149a7a43e51843f95ebbc P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting consensus metadata
I20260808 08:47:12.130913 11696 catalog_manager.cc:4841] TS 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351): tablet f43be5fe851149a7a43e51843f95ebbc (table test-table [id=af4a80c70c5b4560878b6638e0c69aca]) successfully deleted
I20260808 08:47:12.131933 12551 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: No bootstrap required, opened a new log
I20260808 08:47:12.132239 12551 ts_tablet_manager.cc:1397] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.007s
I20260808 08:47:12.132330 12548 tablet_bootstrap.cc:492] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: No bootstrap required, opened a new log
I20260808 08:47:12.132575 12548 ts_tablet_manager.cc:1397] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260808 08:47:12.132858 11701 catalog_manager.cc:4841] TS 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943): tablet f43be5fe851149a7a43e51843f95ebbc (table test-table [id=af4a80c70c5b4560878b6638e0c69aca]) successfully deleted
I20260808 08:47:12.133186 12551 raft_consensus.cc:348] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.133478 12551 raft_consensus.cc:374] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:12.133384 12548 raft_consensus.cc:348] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.133599 12551 raft_consensus.cc:729] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Initialized, Role: FOLLOWER
I20260808 08:47:12.133625 12548 raft_consensus.cc:374] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:12.133705 12548 raft_consensus.cc:729] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Initialized, Role: FOLLOWER
I20260808 08:47:12.133901 12551 consensus_queue.cc:260] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.133983 12548 consensus_queue.cc:260] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.134508 12551 ts_tablet_manager.cc:1428] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:47:12.135974 12548 ts_tablet_manager.cc:1428] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:12.182503 12571 raft_consensus.cc:482] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:12.182756 12571 raft_consensus.cc:504] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.183461 12571 leader_election.cc:288] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:12.184082 11968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9cd8251da04c8fa0d790ebb9a57602" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" is_pre_election: true
I20260808 08:47:12.184158 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9cd8251da04c8fa0d790ebb9a57602" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86" is_pre_election: true
I20260808 08:47:12.184417 11968 raft_consensus.cc:2454] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:12.184450 12435 raft_consensus.cc:2454] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:12.185014 12085 leader_election.cc:302] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:12.185515 12571 raft_consensus.cc:2781] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:12.185719 12571 raft_consensus.cc:482] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:12.185947 12571 raft_consensus.cc:3037] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:12.188395 12571 raft_consensus.cc:504] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.189122 12571 leader_election.cc:288] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Requested vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:12.189565 11968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9cd8251da04c8fa0d790ebb9a57602" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
I20260808 08:47:12.189613 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f9cd8251da04c8fa0d790ebb9a57602" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86"
I20260808 08:47:12.189795 11968 raft_consensus.cc:3037] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:12.189845 12435 raft_consensus.cc:3037] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:12.192844 12435 raft_consensus.cc:2454] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:12.192844 11968 raft_consensus.cc:2454] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:12.193296 12081 leader_election.cc:302] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1695128dfa14499995accf07a7f80c86, 588fdf8f52f346b5b1cf54fbd697b297; no voters:
I20260808 08:47:12.193678 12571 raft_consensus.cc:2781] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:12.193892 12571 raft_consensus.cc:686] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Becoming Leader. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Running, Role: LEADER
I20260808 08:47:12.194224 12571 consensus_queue.cc:237] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:12.197096 11718 catalog_manager.cc:5495] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:12.239092 12435 raft_consensus.cc:1261] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:12.239167 11968 raft_consensus.cc:1261] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:12.239742 12571 consensus_queue.cc:1035] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:12.240123 12564 consensus_queue.cc:1035] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:47:12.263667 12633 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:47:13.851455 11718 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:13.851658 11718 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:13.855589 11718 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Sending DeleteTablet for 3 replicas of tablet 7f9cd8251da04c8fa0d790ebb9a57602
I20260808 08:47:13.856509 12160 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:13 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:55022
I20260808 08:47:13.856478 11937 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:13 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:53208
I20260808 08:47:13.856492 12401 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f9cd8251da04c8fa0d790ebb9a57602 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:13 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:47360
I20260808 08:47:13.867379 12685 tablet_replica.cc:330] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: stopping tablet replica
I20260808 08:47:13.867801 12685 raft_consensus.cc:2229] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:13.868198 12685 raft_consensus.cc:2258] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:13.869390 12685 ts_tablet_manager.cc:1905] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:13.869956 12683 tablet_replica.cc:330] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: stopping tablet replica
I20260808 08:47:13.870795 12682 tablet_replica.cc:330] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: stopping tablet replica
I20260808 08:47:13.870980 12682 raft_consensus.cc:2229] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:13.871196 12682 raft_consensus.cc:2258] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:13.871506 12683 raft_consensus.cc:2229] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:13.871891 12683 raft_consensus.cc:2258] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:13.872689 12682 ts_tablet_manager.cc:1905] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:13.876674 12685 ts_tablet_manager.cc:1918] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:13.876879 12685 log.cc:1196] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/7f9cd8251da04c8fa0d790ebb9a57602
I20260808 08:47:13.876983 12683 ts_tablet_manager.cc:1905] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:13.877434 12685 ts_tablet_manager.cc:1939] T 7f9cd8251da04c8fa0d790ebb9a57602 P 1695128dfa14499995accf07a7f80c86: Deleting consensus metadata
I20260808 08:47:13.878585 11696 catalog_manager.cc:4841] TS 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351): tablet 7f9cd8251da04c8fa0d790ebb9a57602 (table test-table [id=4cf75fa484044c53a3ac6054a5a282ae]) successfully deleted
I20260808 08:47:13.879247 12682 ts_tablet_manager.cc:1918] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:13.879401 12682 log.cc:1196] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/7f9cd8251da04c8fa0d790ebb9a57602
I20260808 08:47:13.879804 12682 ts_tablet_manager.cc:1939] T 7f9cd8251da04c8fa0d790ebb9a57602 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting consensus metadata
I20260808 08:47:13.880775 11701 catalog_manager.cc:4841] TS 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943): tablet 7f9cd8251da04c8fa0d790ebb9a57602 (table test-table [id=4cf75fa484044c53a3ac6054a5a282ae]) successfully deleted
I20260808 08:47:13.883466 12683 ts_tablet_manager.cc:1918] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:13.883569 12683 log.cc:1196] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/7f9cd8251da04c8fa0d790ebb9a57602
I20260808 08:47:13.884018 12683 ts_tablet_manager.cc:1939] T 7f9cd8251da04c8fa0d790ebb9a57602 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting consensus metadata
I20260808 08:47:13.884922 11701 catalog_manager.cc:4841] TS 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809): tablet 7f9cd8251da04c8fa0d790ebb9a57602 (table test-table [id=4cf75fa484044c53a3ac6054a5a282ae]) successfully deleted
Aug 08 08:47:13 dist-test-slave-7vjv krb5kdc[11645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178833, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:47:13 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178833, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:13.917438 12697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:13.903570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40276 (local address 127.8.149.126:39825)
0808 08:47:13.904256 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:13.904263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:13.904288 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:47:13.904515 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:13.904520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:13.904626 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:13.904738 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:13.906043 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:13.906868 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:13.908246 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:13.908626 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:13.908721 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:13.912482 (+ 3761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:13.912487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:13.912490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:13.912520 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:13.915029 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:13.915615 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:13.915619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:13.915620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:13.915721 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:13.916085 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:13.916120 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:13.916124 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:13.916375 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:13.916599 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:13.916924 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:47:13.917135 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":343,"threads_started":1}
I20260808 08:47:13.921002 11718 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:13.921577 11718 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:13.928479 12160 tablet_service.cc:1467] Processing CreateTablet for tablet c78db83cb2fc436594220b1a308ed813 (DEFAULT_TABLE table=test-table [id=75234cbbe03244a891b5458cdc16da62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:13.928535 11937 tablet_service.cc:1467] Processing CreateTablet for tablet c78db83cb2fc436594220b1a308ed813 (DEFAULT_TABLE table=test-table [id=75234cbbe03244a891b5458cdc16da62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:13.928582 12401 tablet_service.cc:1467] Processing CreateTablet for tablet c78db83cb2fc436594220b1a308ed813 (DEFAULT_TABLE table=test-table [id=75234cbbe03244a891b5458cdc16da62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:13.928951 12160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c78db83cb2fc436594220b1a308ed813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:13.928980 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c78db83cb2fc436594220b1a308ed813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:13.929039 12401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c78db83cb2fc436594220b1a308ed813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:13.935407 12699 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Bootstrap starting.
I20260808 08:47:13.936652 12703 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Bootstrap starting.
I20260808 08:47:13.937229 12702 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Bootstrap starting.
I20260808 08:47:13.937309 12699 tablet_bootstrap.cc:654] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:13.939043 12703 tablet_bootstrap.cc:654] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:13.939232 12702 tablet_bootstrap.cc:654] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:13.941334 12703 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: No bootstrap required, opened a new log
I20260808 08:47:13.941504 12703 ts_tablet_manager.cc:1397] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 08:47:13.941782 12702 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: No bootstrap required, opened a new log
I20260808 08:47:13.941955 12702 ts_tablet_manager.cc:1397] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 08:47:13.942353 12699 tablet_bootstrap.cc:492] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: No bootstrap required, opened a new log
I20260808 08:47:13.942502 12699 ts_tablet_manager.cc:1397] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260808 08:47:13.942437 12703 raft_consensus.cc:348] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.942682 12703 raft_consensus.cc:374] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:13.942641 12702 raft_consensus.cc:348] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.942788 12703 raft_consensus.cc:729] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Initialized, Role: FOLLOWER
I20260808 08:47:13.942864 12702 raft_consensus.cc:374] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:13.943004 12702 raft_consensus.cc:729] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1695128dfa14499995accf07a7f80c86, State: Initialized, Role: FOLLOWER
I20260808 08:47:13.943011 12703 consensus_queue.cc:260] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.943292 12699 raft_consensus.cc:348] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.943397 12702 consensus_queue.cc:260] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.943522 12699 raft_consensus.cc:374] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:13.943619 12699 raft_consensus.cc:729] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Initialized, Role: FOLLOWER
I20260808 08:47:13.943722 12703 ts_tablet_manager.cc:1428] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 08:47:13.943872 12699 consensus_queue.cc:260] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:13.945953 12702 ts_tablet_manager.cc:1428] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 08:47:13.947290 12699 ts_tablet_manager.cc:1428] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260808 08:47:14.061439 12665 raft_consensus.cc:482] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:14.061688 12665 raft_consensus.cc:504] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.062345 12665 leader_election.cc:288] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:14.062911 11968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c78db83cb2fc436594220b1a308ed813" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" is_pre_election: true
I20260808 08:47:14.063030 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c78db83cb2fc436594220b1a308ed813" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86" is_pre_election: true
I20260808 08:47:14.063199 11968 raft_consensus.cc:2454] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:14.063278 12435 raft_consensus.cc:2454] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 0.
I20260808 08:47:14.063793 12085 leader_election.cc:302] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:14.064059 12665 raft_consensus.cc:2781] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:14.064234 12665 raft_consensus.cc:482] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:14.064345 12665 raft_consensus.cc:3037] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.066370 12665 raft_consensus.cc:504] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.066952 12665 leader_election.cc:288] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Requested vote from peers 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:14.067425 11968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c78db83cb2fc436594220b1a308ed813" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d"
I20260808 08:47:14.067643 11968 raft_consensus.cc:3037] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.067713 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c78db83cb2fc436594220b1a308ed813" candidate_uuid: "588fdf8f52f346b5b1cf54fbd697b297" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86"
I20260808 08:47:14.068007 12435 raft_consensus.cc:3037] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.069886 11968 raft_consensus.cc:2454] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:14.070273 12435 raft_consensus.cc:2454] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 588fdf8f52f346b5b1cf54fbd697b297 in term 1.
I20260808 08:47:14.070350 12085 leader_election.cc:302] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:14.070669 12665 raft_consensus.cc:2781] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:14.070837 12665 raft_consensus.cc:686] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Becoming Leader. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Running, Role: LEADER
I20260808 08:47:14.071130 12665 consensus_queue.cc:237] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.073772 11720 catalog_manager.cc:5495] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 reported cstate change: term changed from 0 to 1, leader changed from <none> to 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "588fdf8f52f346b5b1cf54fbd697b297" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:14.099875 12712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.095168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55044 (local address 127.8.149.66:46809)
0808 08:47:14.095765 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.095769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.095786 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:47:14.095829 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.095833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.095883 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.095958 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:14.096337 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.097120 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.098361 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.098764 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.098849 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.099221 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.099319 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.099419 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.099538 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.099598 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":397,"threads_started":1}
I20260808 08:47:14.107874 12435 raft_consensus.cc:1261] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:14.108163 11968 raft_consensus.cc:1261] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Refusing update from remote peer 588fdf8f52f346b5b1cf54fbd697b297: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:14.108494 12657 consensus_queue.cc:1035] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:14.108840 12650 consensus_queue.cc:1035] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:14.149814 11720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:14.150202 11720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:14.153422 11720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Sending DeleteTablet for 3 replicas of tablet c78db83cb2fc436594220b1a308ed813
I20260808 08:47:14.154199 11937 tablet_service.cc:1514] Processing DeleteTablet for tablet c78db83cb2fc436594220b1a308ed813 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:14 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:53208
I20260808 08:47:14.154323 12161 tablet_service.cc:1514] Processing DeleteTablet for tablet c78db83cb2fc436594220b1a308ed813 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:14 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:55022
I20260808 08:47:14.154551 12682 tablet_replica.cc:330] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: stopping tablet replica
I20260808 08:47:14.154502 12401 tablet_service.cc:1514] Processing DeleteTablet for tablet c78db83cb2fc436594220b1a308ed813 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:14 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:47360
I20260808 08:47:14.154807 12685 tablet_replica.cc:330] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: stopping tablet replica
I20260808 08:47:14.154801 12682 raft_consensus.cc:2229] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:14.154989 12682 raft_consensus.cc:2258] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:14.155035 12685 raft_consensus.cc:2229] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:14.155280 12683 tablet_replica.cc:330] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: stopping tablet replica
I20260808 08:47:14.155272 12685 raft_consensus.cc:2258] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:14.155524 12683 raft_consensus.cc:2229] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:14.155850 12683 raft_consensus.cc:2258] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:14.156054 11720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:14.156991 11720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:14.157028 12683 ts_tablet_manager.cc:1905] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:14.157248 12685 ts_tablet_manager.cc:1905] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:14.160822 12682 ts_tablet_manager.cc:1905] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:14.162894 12685 ts_tablet_manager.cc:1918] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:14.163031 12685 log.cc:1196] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/c78db83cb2fc436594220b1a308ed813
I20260808 08:47:14.163466 12685 ts_tablet_manager.cc:1939] T c78db83cb2fc436594220b1a308ed813 P 1695128dfa14499995accf07a7f80c86: Deleting consensus metadata
I20260808 08:47:14.163765 12683 ts_tablet_manager.cc:1918] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:14.163911 12683 log.cc:1196] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/c78db83cb2fc436594220b1a308ed813
I20260808 08:47:14.164353 12683 ts_tablet_manager.cc:1939] T c78db83cb2fc436594220b1a308ed813 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting consensus metadata
I20260808 08:47:14.164570 11696 catalog_manager.cc:4841] TS 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351): tablet c78db83cb2fc436594220b1a308ed813 (table test-table [id=75234cbbe03244a891b5458cdc16da62]) successfully deleted
I20260808 08:47:14.165071 11937 tablet_service.cc:1467] Processing CreateTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 (DEFAULT_TABLE table=test-table [id=95790d7390fe4b449c63cb558366fbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:14.165095 12161 tablet_service.cc:1467] Processing CreateTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 (DEFAULT_TABLE table=test-table [id=95790d7390fe4b449c63cb558366fbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:14.165459 11701 catalog_manager.cc:4841] TS 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809): tablet c78db83cb2fc436594220b1a308ed813 (table test-table [id=75234cbbe03244a891b5458cdc16da62]) successfully deleted
I20260808 08:47:14.165506 12161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d40fd89ce54fd49c25db557b9a90c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:14.165637 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d40fd89ce54fd49c25db557b9a90c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:14.168154 12682 ts_tablet_manager.cc:1918] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:47:14.168295 12682 log.cc:1196] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/c78db83cb2fc436594220b1a308ed813
I20260808 08:47:14.168627 12682 ts_tablet_manager.cc:1939] T c78db83cb2fc436594220b1a308ed813 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting consensus metadata
I20260808 08:47:14.169409 11701 catalog_manager.cc:4841] TS 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943): tablet c78db83cb2fc436594220b1a308ed813 (table test-table [id=75234cbbe03244a891b5458cdc16da62]) successfully deleted
I20260808 08:47:14.172046 12703 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Bootstrap starting.
I20260808 08:47:14.172374 12699 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Bootstrap starting.
I20260808 08:47:14.173008 12401 tablet_service.cc:1467] Processing CreateTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 (DEFAULT_TABLE table=test-table [id=95790d7390fe4b449c63cb558366fbda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:14.173398 12401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49d40fd89ce54fd49c25db557b9a90c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:14.173700 12699 tablet_bootstrap.cc:654] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:14.173830 12703 tablet_bootstrap.cc:654] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:14.175797 12699 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: No bootstrap required, opened a new log
I20260808 08:47:14.176069 12699 ts_tablet_manager.cc:1397] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260808 08:47:14.177007 12703 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: No bootstrap required, opened a new log
I20260808 08:47:14.176913 12699 raft_consensus.cc:348] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.177160 12703 ts_tablet_manager.cc:1397] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:47:14.177208 12699 raft_consensus.cc:374] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:14.177292 12699 raft_consensus.cc:729] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Initialized, Role: FOLLOWER
I20260808 08:47:14.177541 12699 consensus_queue.cc:260] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.177846 12703 raft_consensus.cc:348] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.178072 12703 raft_consensus.cc:374] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:14.178102 12699 ts_tablet_manager.cc:1428] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:47:14.178143 12703 raft_consensus.cc:729] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588fdf8f52f346b5b1cf54fbd697b297, State: Initialized, Role: FOLLOWER
I20260808 08:47:14.178404 12703 consensus_queue.cc:260] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.178915 12703 ts_tablet_manager.cc:1428] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:47:14.179672 12702 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Bootstrap starting.
I20260808 08:47:14.181195 12702 tablet_bootstrap.cc:654] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:14.184417 12702 tablet_bootstrap.cc:492] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: No bootstrap required, opened a new log
I20260808 08:47:14.184585 12702 ts_tablet_manager.cc:1397] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:47:14.185261 12702 raft_consensus.cc:348] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.185596 12702 raft_consensus.cc:374] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:14.185716 12702 raft_consensus.cc:729] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1695128dfa14499995accf07a7f80c86, State: Initialized, Role: FOLLOWER
I20260808 08:47:14.185982 12702 consensus_queue.cc:260] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.186519 12702 ts_tablet_manager.cc:1428] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:47:14.595099 12709 raft_consensus.cc:482] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:14.595404 12709 raft_consensus.cc:504] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.597597 12709 leader_election.cc:288] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:14.608951 12722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.598069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46351 (local address 127.8.149.65:57423)
0808 08:47:14.600471 (+ 2402us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:14.600488 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:14.600682 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:14.601247 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:14.601251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:14.601275 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:14.602031 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.602046 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.603774 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.603789 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.606278 (+ 2489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.606290 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.607925 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.607933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.608096 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.608165 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 08:47:14.608305 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:47:14.608470 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2194,"mutex_wait_us":21,"thread_start_us":1096,"threads_started":1}
I20260808 08:47:14.609156 12712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.598117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:60433 (local address 127.8.149.66:46809)
0808 08:47:14.598382 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.598394 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.599962 (+ 1568us) server_negotiation.cc:407] Connection header received
0808 08:47:14.600385 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.600408 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.600492 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.600641 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:14.601556 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.602691 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.605650 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.607761 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.607986 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.608075 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.608699 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.608830 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:47:14.609234 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.598121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:57423 (local address 127.8.149.67:46351)
0808 08:47:14.599351 (+ 1230us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.599358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.600593 (+ 1235us) server_negotiation.cc:407] Connection header received
0808 08:47:14.600990 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.600996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.601079 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.601234 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:14.602290 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.603596 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.606423 (+ 2827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.607716 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.607947 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.608028 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.608360 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.608626 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1028,"thread_start_us":745,"threads_started":1}
I20260808 08:47:14.610101 12726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.597888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:46809 (local address 127.8.149.65:60433)
0808 08:47:14.599768 (+ 1880us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:14.599802 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:14.600159 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:14.600677 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:14.600682 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:14.600710 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:14.601280 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.601294 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.602864 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.602869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.605459 (+ 2590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.605474 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.608300 (+ 2826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.608306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.608502 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.608531 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:47:14.609363 (+ 832us) client_negotiation.cc:240] Negotiation successful
0808 08:47:14.609516 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1525,"mutex_wait_us":3,"thread_start_us":1977,"threads_started":1}
I20260808 08:47:14.610067 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d40fd89ce54fd49c25db557b9a90c4" candidate_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86" is_pre_election: true
I20260808 08:47:14.610427 12435 raft_consensus.cc:2454] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d in term 0.
I20260808 08:47:14.611316 11863 leader_election.cc:302] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1695128dfa14499995accf07a7f80c86, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:14.611511 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d40fd89ce54fd49c25db557b9a90c4" candidate_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588fdf8f52f346b5b1cf54fbd697b297" is_pre_election: true
I20260808 08:47:14.612048 12709 raft_consensus.cc:2781] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:14.612071 12196 raft_consensus.cc:2454] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d in term 0.
I20260808 08:47:14.612317 12709 raft_consensus.cc:482] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:14.612475 12709 raft_consensus.cc:3037] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.615137 12709 raft_consensus.cc:504] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.615744 12709 leader_election.cc:288] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [CANDIDATE]: Term 1 election: Requested vote from peers 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809), 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351)
I20260808 08:47:14.616281 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d40fd89ce54fd49c25db557b9a90c4" candidate_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "588fdf8f52f346b5b1cf54fbd697b297"
I20260808 08:47:14.616472 12196 raft_consensus.cc:3037] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.616454 12435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49d40fd89ce54fd49c25db557b9a90c4" candidate_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1695128dfa14499995accf07a7f80c86"
I20260808 08:47:14.616708 12435 raft_consensus.cc:3037] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:14.618499 12196 raft_consensus.cc:2454] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d in term 1.
I20260808 08:47:14.618889 11865 leader_election.cc:302] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 588fdf8f52f346b5b1cf54fbd697b297, 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d; no voters:
I20260808 08:47:14.619216 12709 raft_consensus.cc:2781] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:14.620352 12435 raft_consensus.cc:2454] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d in term 1.
I20260808 08:47:14.620450 12709 raft_consensus.cc:686] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 LEADER]: Becoming Leader. State: Replica: 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d, State: Running, Role: LEADER
I20260808 08:47:14.620975 12709 consensus_queue.cc:237] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } }
I20260808 08:47:14.624426 11713 catalog_manager.cc:5495] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65). New cstate: current_term: 1 leader_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a1d7d0e4a1e4f088fdb8bfdf89d7d6d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 45943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:14.649133 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.643457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53222 (local address 127.8.149.65:45943)
0808 08:47:14.644289 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.644293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.644312 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:14.644379 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.644383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.644455 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.644633 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:14.645053 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.645816 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.647100 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.647494 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.647580 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.647926 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.648517 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.648644 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.648716 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.648770 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":566,"threads_started":1}
I20260808 08:47:14.664875 12712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.658877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:57453 (local address 127.8.149.66:46809)
0808 08:47:14.659102 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.659111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.659496 (+ 385us) server_negotiation.cc:407] Connection header received
0808 08:47:14.659746 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.659760 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.659832 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.659946 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:14.660506 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.661276 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.662869 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.663275 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.663447 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.663925 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.664055 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.664201 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.664429 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.664518 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:47:14.664991 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.658700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:46809 (local address 127.8.149.65:57453)
0808 08:47:14.659384 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:14.659403 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:14.659584 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:14.659963 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:14.659969 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:14.659982 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:14.660326 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.660337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.661454 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.661462 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.662698 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.662711 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.663485 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.663494 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.663645 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.663716 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.664243 (+ 527us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.664256 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 08:47:14.664391 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 08:47:14.664541 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":319,"threads_started":1}
I20260808 08:47:14.673041 12196 raft_consensus.cc:1261] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Refusing update from remote peer 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:14.673642 12435 raft_consensus.cc:1261] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Refusing update from remote peer 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:14.673861 12727 consensus_queue.cc:1035] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "588fdf8f52f346b5b1cf54fbd697b297" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 46809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:14.674244 12709 consensus_queue.cc:1035] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1695128dfa14499995accf07a7f80c86" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:14.697619 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.692652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:42175 (local address 127.8.149.65:45943)
0808 08:47:14.693062 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:14.693067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:14.693144 (+ 77us) server_negotiation.cc:407] Connection header received
0808 08:47:14.693341 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:14.693346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:14.693420 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:14.693510 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:14.693909 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.694608 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.696245 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.696678 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.696769 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.697112 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.697198 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.697262 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:14.697352 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 08:47:14.697405 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300}
I20260808 08:47:14.697655 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:14.692506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:45943 (local address 127.8.149.66:42175)
0808 08:47:14.693067 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:14.693089 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:14.693209 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:14.693542 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:14.693559 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:14.693572 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:47:14.693782 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.693790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.694748 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.694753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.696059 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:14.696073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:14.696805 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:14.696809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:14.696942 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:14.696976 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:47:14.697277 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:47:14.697286 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:47:14.697340 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 08:47:14.697435 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":261,"threads_started":1}
W20260808 08:47:14.698526 12659 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:47:16.312502 11713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:16.312739 11713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:16.316807 11713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6be4373fe20543baaeb5a99806aff160: Sending DeleteTablet for 3 replicas of tablet 49d40fd89ce54fd49c25db557b9a90c4
I20260808 08:47:16.317580 11937 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:53208
I20260808 08:47:16.317646 12161 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:55022
I20260808 08:47:16.317678 12401 tablet_service.cc:1514] Processing DeleteTablet for tablet 49d40fd89ce54fd49c25db557b9a90c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:47360
I20260808 08:47:16.318485 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11831
I20260808 08:47:16.328063 12797 tablet_replica.cc:330] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: stopping tablet replica
I20260808 08:47:16.328975 12794 tablet_replica.cc:330] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: stopping tablet replica
I20260808 08:47:16.329021 12797 raft_consensus.cc:2229] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:16.329259 12797 raft_consensus.cc:2258] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:16.329632 12794 raft_consensus.cc:2229] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:16.330310 12797 ts_tablet_manager.cc:1905] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:16.330343 12794 raft_consensus.cc:2258] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:16.331168 12796 tablet_replica.cc:330] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: stopping tablet replica
I20260808 08:47:16.331367 12796 raft_consensus.cc:2229] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:16.331555 12794 ts_tablet_manager.cc:1905] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:16.331632 12796 raft_consensus.cc:2258] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:16.332592 12796 ts_tablet_manager.cc:1905] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:16.338411 12794 ts_tablet_manager.cc:1918] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:16.338626 12794 log.cc:1196] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/49d40fd89ce54fd49c25db557b9a90c4
I20260808 08:47:16.339182 12794 ts_tablet_manager.cc:1939] T 49d40fd89ce54fd49c25db557b9a90c4 P 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d: Deleting consensus metadata
I20260808 08:47:16.339849 12796 ts_tablet_manager.cc:1918] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:16.340059 12796 log.cc:1196] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/49d40fd89ce54fd49c25db557b9a90c4
I20260808 08:47:16.340389 11701 catalog_manager.cc:4841] TS 9a1d7d0e4a1e4f088fdb8bfdf89d7d6d (127.8.149.65:45943): tablet 49d40fd89ce54fd49c25db557b9a90c4 (table test-table [id=95790d7390fe4b449c63cb558366fbda]) successfully deleted
I20260808 08:47:16.341310 12796 ts_tablet_manager.cc:1939] T 49d40fd89ce54fd49c25db557b9a90c4 P 1695128dfa14499995accf07a7f80c86: Deleting consensus metadata
I20260808 08:47:16.342955 11696 catalog_manager.cc:4841] TS 1695128dfa14499995accf07a7f80c86 (127.8.149.67:46351): tablet 49d40fd89ce54fd49c25db557b9a90c4 (table test-table [id=95790d7390fe4b449c63cb558366fbda]) successfully deleted
I20260808 08:47:16.343587 12797 ts_tablet_manager.cc:1918] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:47:16.343813 12797 log.cc:1196] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/49d40fd89ce54fd49c25db557b9a90c4
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178833, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:16.344408 12797 ts_tablet_manager.cc:1939] T 49d40fd89ce54fd49c25db557b9a90c4 P 588fdf8f52f346b5b1cf54fbd697b297: Deleting consensus metadata
I20260808 08:47:16.345567 11701 catalog_manager.cc:4841] TS 588fdf8f52f346b5b1cf54fbd697b297 (127.8.149.66:46809): tablet 49d40fd89ce54fd49c25db557b9a90c4 (table test-table [id=95790d7390fe4b449c63cb558366fbda]) successfully deleted
I20260808 08:47:16.354657 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:16.320376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53224 (local address 127.8.149.65:45943)
0808 08:47:16.328718 (+ 8342us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:16.328729 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:16.328756 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:47:16.328810 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:16.328814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:16.328900 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:16.329011 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:16.331442 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.333073 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.334828 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.335504 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.335613 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:16.345794 (+ 10181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:16.345810 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:16.345829 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:16.345864 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:16.349688 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.352017 (+ 2329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.352030 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.352036 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.352242 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.352729 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.352736 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.352741 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.353315 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:16.353684 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:16.354019 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 08:47:16.354261 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8151,"thread_start_us":7936,"threads_started":1}
W20260808 08:47:16.355378 12039 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53224
W20260808 08:47:16.356199 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11831: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:16.356434 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11831
I20260808 08:47:16.394389 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12052
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178833, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:16.408878 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:16.395264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55050 (local address 127.8.149.66:46809)
0808 08:47:16.395793 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:16.395797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:16.395813 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:47:16.395877 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:16.395880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:16.395963 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:16.396050 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:16.397415 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.398170 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.399313 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.399730 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.399816 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:16.403613 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:16.403625 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:16.403638 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:16.403666 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:16.406534 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.407114 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.407121 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.407123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.407237 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.407524 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.407527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.407529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.407849 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:16.408053 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:16.408346 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 08:47:16.408494 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":275,"threads_started":1}
W20260808 08:47:16.409523 12271 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55050
W20260808 08:47:16.410100 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12052: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:16.410246 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12052
I20260808 08:47:16.445783 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12287
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[11645](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178833, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:16.461107 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:16.446586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47370 (local address 127.8.149.67:46351)
0808 08:47:16.447151 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:16.447155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:16.447170 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:47:16.447222 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:16.447225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:16.447281 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:16.447404 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:16.448818 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.449694 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.450913 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:16.451364 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:16.451497 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:16.455667 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:16.455681 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:16.455696 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:16.455730 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:16.458384 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.458983 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.458990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.458992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.459149 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:16.459523 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:16.459528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:16.459530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:16.459976 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:16.460259 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:16.460662 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 08:47:16.460809 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":264,"threads_started":1}
W20260808 08:47:16.461787 12516 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47370
W20260808 08:47:16.462438 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:16.462610 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12287
I20260808 08:47:16.492012 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11668
I20260808 08:47:16.493237 11786 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:16.608338 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11668
2026-08-08T08:47:16Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8946 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[12810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[12810](info): set up 2 sockets
Aug 08 08:47:16 dist-test-slave-7vjv krb5kdc[12810](info): commencing operation
krb5kdc: starting...
W20260808 08:47:17.922465 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:18 dist-test-slave-7vjv krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:18.119539 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39841
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:18.444314 12830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:18.444594 12830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:18.444761 12830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:18.451660 12830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:18.451768 12830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:18.451895 12830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:18.451994 12830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:18.452081 12830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:18.461651 12830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:18.462939 12830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:18.464298 12830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:18.476938 12835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:18.476997 12837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:18.477025 12841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:18.485666 12830 server_base.cc:1034] running on GCE node
I20260808 08:47:18.486449 12830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:18.487840 12830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:18.489058 12830 hybrid_clock.cc:648] HybridClock initialized: now 1786178838489006 us; error 36 us; skew 500 ppm
I20260808 08:47:18.489380 12830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:18 dist-test-slave-7vjv krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178838, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:18.492524 12830 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:18.494011 12830 webserver.cc:460] Webserver started at http://127.8.149.126:36333/ using document root <none> and password file <none>
I20260808 08:47:18.494730 12830 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:18.494835 12830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:18.495080 12830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:18.497954 12830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "901bfdf23ba54ffbba526b1485b93d73"
format_stamp: "Formatted at 2026-08-08 08:47:18 on dist-test-slave-7vjv"
server_key: "1b79f52bc6f2a7cece3620352973c455"
server_key_iv: "a54478c4850a5a95a462462f7c0c9625"
server_key_version: "encryptionkey@0"
I20260808 08:47:18.498708 12830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "901bfdf23ba54ffbba526b1485b93d73"
format_stamp: "Formatted at 2026-08-08 08:47:18 on dist-test-slave-7vjv"
server_key: "1b79f52bc6f2a7cece3620352973c455"
server_key_iv: "a54478c4850a5a95a462462f7c0c9625"
server_key_version: "encryptionkey@0"
I20260808 08:47:18.504310 12830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 08:47:18.507864 12854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:18.509272 12830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:18.509473 12830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "901bfdf23ba54ffbba526b1485b93d73"
format_stamp: "Formatted at 2026-08-08 08:47:18 on dist-test-slave-7vjv"
server_key: "1b79f52bc6f2a7cece3620352973c455"
server_key_iv: "a54478c4850a5a95a462462f7c0c9625"
server_key_version: "encryptionkey@0"
I20260808 08:47:18.509691 12830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:18.525502 12830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:18.529620 12830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:18.529937 12830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:18.550156 12830 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39841
I20260808 08:47:18.550168 12946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39841 every 8 connection(s)
I20260808 08:47:18.551620 12830 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:18.555686 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12830
I20260808 08:47:18.555902 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:18.556792 8789 external_mini_cluster.cc:1428] Setting key 3153df01ecd88de4e41c0a1f0359ee7f
I20260808 08:47:18.560206 12948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:18 dist-test-slave-7vjv krb5kdc[12810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:18.573980 12948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73: Bootstrap starting.
I20260808 08:47:18.578603 12948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:18.579955 12948 log.cc:824] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:18.583324 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:18.559154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54346 (local address 127.8.149.126:39841)
0808 08:47:18.560204 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:18.560221 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:18.560618 (+ 397us) server_negotiation.cc:407] Connection header received
0808 08:47:18.563139 (+ 2521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:18.563166 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:18.563656 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:18.564135 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:18.565438 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:18.567476 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:18.568819 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:18.570001 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:18.570205 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:18.574168 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:18.574182 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:18.574199 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:18.574252 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:18.578528 (+ 4276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:18.579249 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:18.579258 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:18.579266 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:18.579500 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:18.579896 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:18.579903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:18.579906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:18.580721 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:18.581027 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:18.581539 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 08:47:18.582008 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":464,"threads_started":1}
I20260808 08:47:18.583467 12948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73: No bootstrap required, opened a new log
I20260808 08:47:18.591427 12948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } }
I20260808 08:47:18.591826 12948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:18.591975 12948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901bfdf23ba54ffbba526b1485b93d73, State: Initialized, Role: FOLLOWER
I20260808 08:47:18.592654 12948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } }
I20260808 08:47:18.592947 12948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:18.593087 12948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:18.593286 12948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:18.595578 12948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } }
I20260808 08:47:18.596172 12948 leader_election.cc:302] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 901bfdf23ba54ffbba526b1485b93d73; no voters:
I20260808 08:47:18.596817 12948 leader_election.cc:288] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:18.596913 12957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:18.597731 12957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [term 1 LEADER]: Becoming Leader. State: Replica: 901bfdf23ba54ffbba526b1485b93d73, State: Running, Role: LEADER
I20260808 08:47:18.598369 12957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } }
I20260808 08:47:18.599296 12948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:18.601624 12958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "901bfdf23ba54ffbba526b1485b93d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } } }
I20260808 08:47:18.601619 12959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 901bfdf23ba54ffbba526b1485b93d73. Latest consensus state: current_term: 1 leader_uuid: "901bfdf23ba54ffbba526b1485b93d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "901bfdf23ba54ffbba526b1485b93d73" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39841 } } }
I20260808 08:47:18.602016 12958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:18.602144 12959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:18.604394 12969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:18.608671 12969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:18.617635 12969 catalog_manager.cc:1347] Generated new cluster ID: 56022106eaaf455290f55d1e88dd4b8d
I20260808 08:47:18.617748 12969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:18.631047 12969 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:18.632238 12969 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:18.639153 12969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 901bfdf23ba54ffbba526b1485b93d73: Generated new TSK 0
I20260808 08:47:18.639859 12969 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:18.695878 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:19.027001 12987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:19.027273 12987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:19.027439 12987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:19.035223 12987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:19.035310 12987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:19.035477 12987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:19.044813 12987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:19.046084 12987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:19.047418 12987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:19.060475 12997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:19.060638 12998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:19.060966 13002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:19.061404 12987 server_base.cc:1034] running on GCE node
I20260808 08:47:19.061976 12987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:19.062850 12987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:19.064123 12987 hybrid_clock.cc:648] HybridClock initialized: now 1786178839064041 us; error 42 us; skew 500 ppm
I20260808 08:47:19.064441 12987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:19 dist-test-slave-7vjv krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178839, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:19.067517 12987 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:19.068998 12987 webserver.cc:460] Webserver started at http://127.8.149.65:46811/ using document root <none> and password file <none>
I20260808 08:47:19.069628 12987 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:19.069795 12987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:19.070101 12987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:19.072914 12987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "d73da22996e34d52919ce6048bb9d1fd"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "46feb1bcc45ffc380c87164410e62475"
server_key_iv: "f1604a2334d83f938052f6cd3fba6796"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.073714 12987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "d73da22996e34d52919ce6048bb9d1fd"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "46feb1bcc45ffc380c87164410e62475"
server_key_iv: "f1604a2334d83f938052f6cd3fba6796"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.078619 12987 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:47:19.082124 13017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.083477 12987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:19.083662 12987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "d73da22996e34d52919ce6048bb9d1fd"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "46feb1bcc45ffc380c87164410e62475"
server_key_iv: "f1604a2334d83f938052f6cd3fba6796"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.083837 12987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:19.101995 12987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:19.106074 12987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:19.106360 12987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:19.107226 12987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:19.108536 12987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:19.108615 12987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.108789 12987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:19.108841 12987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.142114 12987 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:43145
I20260808 08:47:19.142156 13212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:43145 every 8 connection(s)
I20260808 08:47:19.143307 12987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:19.147099 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12987
I20260808 08:47:19.147327 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:19.148166 8789 external_mini_cluster.cc:1428] Setting key 6cd49b96ee75d61226ad3c6e3acc0e5f
Aug 08 08:47:19 dist-test-slave-7vjv krb5kdc[12810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178839, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:19.165930 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:19.145991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:46301 (local address 127.8.149.126:39841)
0808 08:47:19.146449 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:19.146454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:19.147402 (+ 948us) server_negotiation.cc:407] Connection header received
0808 08:47:19.149673 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:19.149677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:19.149742 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:19.149832 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:19.151810 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.152552 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.154977 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.155375 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.155482 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:19.160214 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:19.160219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:19.160222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:19.160253 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:19.162917 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:19.163631 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:19.163638 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:19.163643 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:19.163767 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:19.164243 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:19.164249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:19.164252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:19.164503 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:19.164663 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:19.165362 (+ 699us) server_negotiation.cc:299] Negotiation successful
0808 08:47:19.165576 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":259,"threads_started":1}
I20260808 08:47:19.166839 13219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:19.146369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39841 (local address 127.8.149.65:46301)
0808 08:47:19.147211 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:19.147272 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:19.149404 (+ 2132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:19.150101 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:19.150108 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:19.150830 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:19.151630 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:19.151657 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.152704 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.152711 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:19.154756 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:19.154773 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.155614 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.155624 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:19.155991 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:19.156726 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:19.156766 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:19.159964 (+ 3198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:19.163074 (+ 3110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:19.163082 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:19.163097 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:19.163489 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:19.163891 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:19.163896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:19.163899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:19.164087 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:19.164643 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:19.164651 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:19.164967 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 08:47:19.165246 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 08:47:19.165747 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":298,"threads_started":1}
I20260808 08:47:19.168444 13213 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39841
I20260808 08:47:19.168745 13213 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:19.169569 13213 heartbeater.cc:511] Master 127.8.149.126:39841 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
I20260808 08:47:19.171816 12883 ts_manager.cc:194] Registered new tserver with Master: d73da22996e34d52919ce6048bb9d1fd (127.8.149.65:43145)
I20260808 08:47:19.173300 12883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:46301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:19.198617 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:19.525839 13227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:19.526134 13227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:19.526239 13227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:19.533803 13227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:19.533926 13227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:19.534082 13227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:19.543540 13227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:19.544731 13227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:19.546159 13227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:19.559674 13234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:19.560137 13233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:19.560609 13227 server_base.cc:1034] running on GCE node
W20260808 08:47:19.561221 13237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:19.561924 13227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:19.562793 13227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:19.564038 13227 hybrid_clock.cc:648] HybridClock initialized: now 1786178839563993 us; error 42 us; skew 500 ppm
I20260808 08:47:19.564388 13227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:19 dist-test-slave-7vjv krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178839, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:19.567680 13227 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:19.569056 13227 webserver.cc:460] Webserver started at http://127.8.149.66:36675/ using document root <none> and password file <none>
I20260808 08:47:19.569669 13227 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:19.569761 13227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:19.570017 13227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:19.572707 13227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "1120034f84a649489545f1e8a0094c7c"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "9ac70fa00984879d11f7fdd3e19cd26f"
server_key_iv: "fff37678321ed047feed8a9379c14a76"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.573381 13227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "1120034f84a649489545f1e8a0094c7c"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "9ac70fa00984879d11f7fdd3e19cd26f"
server_key_iv: "fff37678321ed047feed8a9379c14a76"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.578104 13227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:47:19.581358 13250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.582595 13227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:19.582769 13227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "1120034f84a649489545f1e8a0094c7c"
format_stamp: "Formatted at 2026-08-08 08:47:19 on dist-test-slave-7vjv"
server_key: "9ac70fa00984879d11f7fdd3e19cd26f"
server_key_iv: "fff37678321ed047feed8a9379c14a76"
server_key_version: "encryptionkey@0"
I20260808 08:47:19.582962 13227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:19.606230 13227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:19.610409 13227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:19.610798 13227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:19.611761 13227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:19.613314 13227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:19.613433 13227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.613621 13227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:19.613703 13227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:19.649262 13227 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:39057
I20260808 08:47:19.649356 13437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:39057 every 8 connection(s)
I20260808 08:47:19.650605 13227 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:19.657768 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13227
I20260808 08:47:19.658023 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:19.658677 8789 external_mini_cluster.cc:1428] Setting key b0ed258a23aeadb73bddd7f9cbb6f845
Aug 08 08:47:19 dist-test-slave-7vjv krb5kdc[12810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178839, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:19.673316 13218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:19.653145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:38463 (local address 127.8.149.126:39841)
0808 08:47:19.653389 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:19.653397 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:19.654615 (+ 1218us) server_negotiation.cc:407] Connection header received
0808 08:47:19.656687 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:19.656693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:19.656782 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:19.656896 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:19.659067 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.660285 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.662094 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.662551 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.662712 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:19.666518 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:19.666524 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:19.666527 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:19.666560 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:19.670010 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:19.670785 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:19.670793 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:19.670797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:19.670976 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:19.671440 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:19.671448 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:19.671452 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:19.671732 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:19.671908 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:19.672672 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 08:47:19.672906 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:47:19.674301 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:19.653680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39841 (local address 127.8.149.66:38463)
0808 08:47:19.654448 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:19.654484 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:19.656390 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:19.657127 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:19.657135 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:19.657966 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:19.658813 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:19.658840 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.660484 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.660490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:19.661890 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:19.661904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:19.662795 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:19.662802 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:19.663049 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:19.663749 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:19.663773 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:19.666285 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:19.670162 (+ 3877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:19.670172 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:19.670186 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:19.670649 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:19.671102 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:19.671108 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:19.671112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:19.671312 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:19.671889 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:19.671898 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:19.672289 (+ 391us) client_negotiation.cc:769] Sending connection context
0808 08:47:19.672566 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 08:47:19.673067 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":299,"threads_started":1}
I20260808 08:47:19.675710 13438 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39841
I20260808 08:47:19.676064 13438 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:19.677017 13438 heartbeater.cc:511] Master 127.8.149.126:39841 requested a full tablet report, sending...
I20260808 08:47:19.678660 12883 ts_manager.cc:194] Registered new tserver with Master: 1120034f84a649489545f1e8a0094c7c (127.8.149.66:39057)
I20260808 08:47:19.679899 12883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:38463
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:19.710870 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:20.040184 13445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:20.040575 13445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:20.040750 13445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:20.048161 13445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:20.048285 13445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:20.048471 13445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:20.058877 13445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39841
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:20.060365 13445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:20.062182 13445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:20.075006 13451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:20.075147 13461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:20.075254 13454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:20.076357 13445 server_base.cc:1034] running on GCE node
I20260808 08:47:20.076978 13445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:20.077901 13445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:20.079106 13445 hybrid_clock.cc:648] HybridClock initialized: now 1786178840079064 us; error 30 us; skew 500 ppm
I20260808 08:47:20.079401 13445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:20 dist-test-slave-7vjv krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178840, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:20.082810 13445 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:20.084388 13445 webserver.cc:460] Webserver started at http://127.8.149.67:45865/ using document root <none> and password file <none>
I20260808 08:47:20.085049 13445 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:20.085151 13445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:20.085393 13445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:20.088554 13445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "2293d97605674d00a804460bf89633cf"
format_stamp: "Formatted at 2026-08-08 08:47:20 on dist-test-slave-7vjv"
server_key: "2d6ad50ea28473318818f225d03f9d8f"
server_key_iv: "b2b5b08477ed11c46f8a98126821ccc9"
server_key_version: "encryptionkey@0"
I20260808 08:47:20.089260 13445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "2293d97605674d00a804460bf89633cf"
format_stamp: "Formatted at 2026-08-08 08:47:20 on dist-test-slave-7vjv"
server_key: "2d6ad50ea28473318818f225d03f9d8f"
server_key_iv: "b2b5b08477ed11c46f8a98126821ccc9"
server_key_version: "encryptionkey@0"
I20260808 08:47:20.094590 13445 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:20.098021 13475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:20.099262 13445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:20.099429 13445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "2293d97605674d00a804460bf89633cf"
format_stamp: "Formatted at 2026-08-08 08:47:20 on dist-test-slave-7vjv"
server_key: "2d6ad50ea28473318818f225d03f9d8f"
server_key_iv: "b2b5b08477ed11c46f8a98126821ccc9"
server_key_version: "encryptionkey@0"
I20260808 08:47:20.099702 13445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:20.119081 13445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:20.123359 13445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:20.123706 13445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:20.124778 13445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:20.126135 13445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:20.126274 13445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:20.126425 13445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:20.126505 13445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:20.173146 13445 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:36791
I20260808 08:47:20.173183 13680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:36791 every 8 connection(s)
I20260808 08:47:20.174443 13445 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:20.176146 13213 heartbeater.cc:503] Master 127.8.149.126:39841 was elected leader, sending a full tablet report...
I20260808 08:47:20.181488 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13445
I20260808 08:47:20.181741 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:20.182276 8789 external_mini_cluster.cc:1428] Setting key 0740ff2488ae591ba232d80ffa15b7a5
Aug 08 08:47:20 dist-test-slave-7vjv krb5kdc[12810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178840, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:20.195035 13684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:20.176970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:39995 (local address 127.8.149.126:39841)
0808 08:47:20.177452 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:20.177458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:20.178479 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 08:47:20.180416 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:20.180420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:20.180483 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:20.180576 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:20.182165 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:20.183121 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:20.185429 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:20.185951 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:20.186055 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:20.189838 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:20.189843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:20.189846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:20.189879 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:20.192447 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:20.193121 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:20.193124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:20.193126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:20.193239 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:20.193635 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:20.193638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:20.193640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:20.193881 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:20.194003 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:20.194572 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 08:47:20.194742 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":234,"threads_started":1}
I20260808 08:47:20.195960 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:20.177596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39841 (local address 127.8.149.67:39995)
0808 08:47:20.178343 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:20.178377 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:20.180081 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:20.180738 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:20.180745 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:20.181299 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:20.181996 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:20.182014 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:20.183307 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:20.183311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:20.185255 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:20.185276 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:20.186178 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:20.186186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:20.186483 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:20.187215 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:20.187241 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:20.189630 (+ 2389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:20.192565 (+ 2935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:20.192571 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:20.192581 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:20.193015 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:20.193325 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:20.193328 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:20.193330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:20.193534 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:20.194012 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:20.194017 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:20.194272 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 08:47:20.194475 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 08:47:20.194887 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":326,"threads_started":1}
I20260808 08:47:20.197327 13681 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39841
I20260808 08:47:20.197654 13681 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:20.198422 13681 heartbeater.cc:511] Master 127.8.149.126:39841 requested a full tablet report, sending...
I20260808 08:47:20.199761 12883 ts_manager.cc:194] Registered new tserver with Master: 2293d97605674d00a804460bf89633cf (127.8.149.67:36791)
I20260808 08:47:20.200663 12883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:39995
I20260808 08:47:20.209838 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:47:20.247798 13684 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:20.245153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55388 (local address 127.8.149.126:39841)
0808 08:47:20.245324 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:20.245329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:20.245842 (+ 513us) server_negotiation.cc:407] Connection header received
0808 08:47:20.246059 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:20.246064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:20.246150 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:20.246225 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:20.247438 (+ 1213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55388: BlockingRecv error: recv got EOF from 127.0.0.1:55388 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:47:20.250861 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12987
W20260808 08:47:20.253697 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12987: Not authorized: Client connection negotiation failed: client connection to 127.8.149.65:43145: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:47:20.253890 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12987
I20260808 08:47:20.279177 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13227
W20260808 08:47:20.281908 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13227: Not authorized: Client connection negotiation failed: client connection to 127.8.149.66:39057: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:47:20.282079 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13227
I20260808 08:47:20.303274 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13445
W20260808 08:47:20.306413 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13445: Not authorized: Client connection negotiation failed: client connection to 127.8.149.67:36791: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:47:20.306563 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13445
I20260808 08:47:20.339541 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12830
I20260808 08:47:20.341281 12942 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:20.446597 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12830
2026-08-08T08:47:20Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3835 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:21 dist-test-slave-7vjv krb5kdc[13719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:21 dist-test-slave-7vjv krb5kdc[13719](info): set up 2 sockets
Aug 08 08:47:21 dist-test-slave-7vjv krb5kdc[13719](info): commencing operation
krb5kdc: starting...
W20260808 08:47:22.959671 8789 mini_kdc.cc:121] Time spent starting KDC: real 2.463s user 0.003s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:23.168851 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44109
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:44109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:23.489821 13737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:23.490115 13737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:23.490311 13737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:23.497483 13737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:23.497599 13737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:23.497701 13737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:23.497794 13737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:23.497880 13737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:23.507189 13737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:44109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:23.508456 13737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:23.509791 13737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:23.521330 13752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:23.521351 13746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:23.521353 13747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:23.522559 13737 server_base.cc:1034] running on GCE node
I20260808 08:47:23.523247 13737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:23.524622 13737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:23.525856 13737 hybrid_clock.cc:648] HybridClock initialized: now 1786178843525788 us; error 63 us; skew 500 ppm
I20260808 08:47:23.526182 13737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178843, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:23.534426 13737 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:23.535836 13737 webserver.cc:460] Webserver started at http://127.8.149.126:42425/ using document root <none> and password file <none>
I20260808 08:47:23.536513 13737 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:23.536613 13737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:23.536862 13737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:23.539837 13737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "47b902d920a4420a9b6906b0fcd1d332"
format_stamp: "Formatted at 2026-08-08 08:47:23 on dist-test-slave-7vjv"
server_key: "e122536eee6a093575dbc89e918a7b56"
server_key_iv: "d0769b15405598942be36fdc4a2daec0"
server_key_version: "encryptionkey@0"
I20260808 08:47:23.540660 13737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "47b902d920a4420a9b6906b0fcd1d332"
format_stamp: "Formatted at 2026-08-08 08:47:23 on dist-test-slave-7vjv"
server_key: "e122536eee6a093575dbc89e918a7b56"
server_key_iv: "d0769b15405598942be36fdc4a2daec0"
server_key_version: "encryptionkey@0"
I20260808 08:47:23.545518 13737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 08:47:23.548826 13761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:23.550160 13737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:23.550292 13737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "47b902d920a4420a9b6906b0fcd1d332"
format_stamp: "Formatted at 2026-08-08 08:47:23 on dist-test-slave-7vjv"
server_key: "e122536eee6a093575dbc89e918a7b56"
server_key_iv: "d0769b15405598942be36fdc4a2daec0"
server_key_version: "encryptionkey@0"
I20260808 08:47:23.550441 13737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:23.571386 13737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:23.575178 13737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:23.575395 13737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:23.593993 13737 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:44109
I20260808 08:47:23.594074 13847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:44109 every 8 connection(s)
I20260808 08:47:23.595367 13737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:23.597616 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13737
I20260808 08:47:23.597843 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:23.598766 8789 external_mini_cluster.cc:1428] Setting key cb087944c440231f5ff1e2b4bba0517c
I20260808 08:47:23.600204 13848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:23.615355 13848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332: Bootstrap starting.
I20260808 08:47:23.618686 13848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:23.620153 13848 log.cc:824] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:23.623463 13848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332: No bootstrap required, opened a new log
I20260808 08:47:23.623493 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:23.600721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35360 (local address 127.8.149.126:44109)
0808 08:47:23.601592 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:23.601603 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:23.601644 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:47:23.603233 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:23.603253 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:23.603679 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:23.604004 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:23.606092 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:23.607463 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:23.609435 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:23.610059 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:23.610189 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:23.615355 (+ 5166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:23.615364 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:23.615379 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:23.615418 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:23.618775 (+ 3357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:23.619741 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:23.619748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:23.619754 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:23.619993 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:23.620469 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:23.620473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:23.620475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:23.621346 (+ 871us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:23.621694 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:23.622108 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 08:47:23.622484 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":426,"threads_started":1}
I20260808 08:47:23.627585 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:47:23.632264 13848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } }
I20260808 08:47:23.632623 13848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:23.632754 13848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b902d920a4420a9b6906b0fcd1d332, State: Initialized, Role: FOLLOWER
I20260808 08:47:23.633316 13848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } }
I20260808 08:47:23.633585 13848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:23.633754 13848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:23.633982 13848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:23.636169 13848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } }
I20260808 08:47:23.636659 13848 leader_election.cc:302] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47b902d920a4420a9b6906b0fcd1d332; no voters:
I20260808 08:47:23.637356 13848 leader_election.cc:288] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:23.637490 13858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:23.638799 13858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [term 1 LEADER]: Becoming Leader. State: Replica: 47b902d920a4420a9b6906b0fcd1d332, State: Running, Role: LEADER
I20260808 08:47:23.639469 13858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } }
I20260808 08:47:23.639878 13848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:23.642735 13859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47b902d920a4420a9b6906b0fcd1d332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } } }
I20260808 08:47:23.643184 13859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:23.644987 13862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b902d920a4420a9b6906b0fcd1d332. Latest consensus state: current_term: 1 leader_uuid: "47b902d920a4420a9b6906b0fcd1d332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47b902d920a4420a9b6906b0fcd1d332" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44109 } } }
I20260808 08:47:23.645394 13867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:23.645488 13862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:23.651947 13867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:23.670146 13867 catalog_manager.cc:1347] Generated new cluster ID: 4ae4c539db414c57a8ec48c699b4e556
I20260808 08:47:23.670363 13867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:23.700627 13891 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:47:23.707114 13867 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:23.708810 13867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:23.714277 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:23.703474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.8.149.126:44109)
0808 08:47:23.703661 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:23.703667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:23.704371 (+ 704us) server_negotiation.cc:407] Connection header received
0808 08:47:23.704596 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:23.704605 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:23.704735 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:23.704992 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:23.706528 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:23.707805 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:23.709721 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:23.710419 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:23.710556 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:23.711850 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:23.711857 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:23.711863 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:23.713219 (+ 1356us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:23.713292 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:23.713357 (+ 65us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:23.713494 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:23.713660 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:47:23.713802 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:47:23.725841 13867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47b902d920a4420a9b6906b0fcd1d332: Generated new TSK 0
I20260808 08:47:23.726825 13867 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:47:23.735546 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13737
I20260808 08:47:23.736792 13841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:23.827924 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13737
2026-08-08T08:47:23Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (3372 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13908](info): set up 2 sockets
Aug 08 08:47:23 dist-test-slave-7vjv krb5kdc[13908](info): commencing operation
krb5kdc: starting...
W20260808 08:47:25.143390 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:25 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:25.345288 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40721
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:25.669725 13935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:25.669999 13935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:25.670198 13935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:25.678210 13935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:25.678339 13935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:25.678431 13935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:25.678519 13935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:25.678591 13935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:25.689289 13935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:25.690512 13935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:25.691808 13935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:25.704494 13943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:25.704461 13946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:25.704411 13951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:25.705305 13935 server_base.cc:1034] running on GCE node
I20260808 08:47:25.706017 13935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:25.707264 13935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:25.708458 13935 hybrid_clock.cc:648] HybridClock initialized: now 1786178845708428 us; error 37 us; skew 500 ppm
I20260808 08:47:25.708742 13935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:25 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178845, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:25.711612 13935 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:25.713058 13935 webserver.cc:460] Webserver started at http://127.8.149.126:39037/ using document root <none> and password file <none>
I20260808 08:47:25.713687 13935 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:25.713836 13935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:25.714177 13935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:25.717025 13935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "30d11eabfac54d5e813af38d6d5f3bea"
format_stamp: "Formatted at 2026-08-08 08:47:25 on dist-test-slave-7vjv"
server_key: "730c0a81b937162ad41d8feac57b8ed1"
server_key_iv: "1a0f33d304065da231128ed29bc68331"
server_key_version: "encryptionkey@0"
I20260808 08:47:25.717777 13935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "30d11eabfac54d5e813af38d6d5f3bea"
format_stamp: "Formatted at 2026-08-08 08:47:25 on dist-test-slave-7vjv"
server_key: "730c0a81b937162ad41d8feac57b8ed1"
server_key_iv: "1a0f33d304065da231128ed29bc68331"
server_key_version: "encryptionkey@0"
I20260808 08:47:25.722867 13935 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:47:25.726502 13963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:25.727844 13935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:47:25.728016 13935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "30d11eabfac54d5e813af38d6d5f3bea"
format_stamp: "Formatted at 2026-08-08 08:47:25 on dist-test-slave-7vjv"
server_key: "730c0a81b937162ad41d8feac57b8ed1"
server_key_iv: "1a0f33d304065da231128ed29bc68331"
server_key_version: "encryptionkey@0"
I20260808 08:47:25.728257 13935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:25.742049 13935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:25.745849 13935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:25.746152 13935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:25.775943 13935 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40721
I20260808 08:47:25.775947 14055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40721 every 8 connection(s)
I20260808 08:47:25.777376 13935 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:25.782683 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13935
I20260808 08:47:25.782948 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:25.783023 14056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:25.783592 8789 external_mini_cluster.cc:1428] Setting key 592620ab931d3c00fe37a5c0ef51a4fb
Aug 08 08:47:25 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:25.803188 14056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea: Bootstrap starting.
I20260808 08:47:25.805790 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:25.785499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60558 (local address 127.8.149.126:40721)
0808 08:47:25.786346 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:25.786356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:25.786400 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:47:25.789048 (+ 2648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:25.789067 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:25.789455 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:25.789840 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:25.791213 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:25.792549 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:25.793788 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:25.794426 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:25.794617 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:25.798668 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:25.798675 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:25.798687 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:25.798730 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:25.801819 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:25.802488 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:25.802494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:25.802499 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:25.802659 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:25.803030 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:25.803035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:25.803037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:25.803558 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:25.803931 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:25.804354 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 08:47:25.804779 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":336,"threads_started":1}
I20260808 08:47:25.808336 14056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:25.809991 14056 log.cc:824] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:25.813410 14056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea: No bootstrap required, opened a new log
I20260808 08:47:25.826730 14056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } }
I20260808 08:47:25.827212 14056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:25.827327 14056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d11eabfac54d5e813af38d6d5f3bea, State: Initialized, Role: FOLLOWER
I20260808 08:47:25.827992 14056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } }
I20260808 08:47:25.828298 14056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:25.828464 14056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:25.828649 14056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:25.832281 14056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } }
I20260808 08:47:25.832870 14056 leader_election.cc:302] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30d11eabfac54d5e813af38d6d5f3bea; no voters:
I20260808 08:47:25.833582 14056 leader_election.cc:288] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:25.833649 14064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:25.835525 14064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [term 1 LEADER]: Becoming Leader. State: Replica: 30d11eabfac54d5e813af38d6d5f3bea, State: Running, Role: LEADER
I20260808 08:47:25.835795 14056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:25.836215 14064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } }
I20260808 08:47:25.839048 14067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30d11eabfac54d5e813af38d6d5f3bea. Latest consensus state: current_term: 1 leader_uuid: "30d11eabfac54d5e813af38d6d5f3bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } } }
I20260808 08:47:25.839397 14067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:25.839949 14065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30d11eabfac54d5e813af38d6d5f3bea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30d11eabfac54d5e813af38d6d5f3bea" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40721 } } }
I20260808 08:47:25.840327 14065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:25.843056 14085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:25.847774 14085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:25.854930 14085 catalog_manager.cc:1347] Generated new cluster ID: ffbe3f19297242c893ad3be574a615ff
I20260808 08:47:25.855027 14085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:25.875952 14085 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:25.877240 14085 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:25.886418 14085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30d11eabfac54d5e813af38d6d5f3bea: Generated new TSK 0
I20260808 08:47:25.887140 14085 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:25.948047 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:26.280516 14102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:26.280766 14102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:26.280933 14102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:26.287839 14102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:26.287954 14102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:26.288189 14102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:26.297602 14102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:26.298735 14102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:26.299999 14102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:26.313048 14110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:26.313009 14118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:26.313081 14114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:26.313971 14102 server_base.cc:1034] running on GCE node
I20260808 08:47:26.314496 14102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:26.315444 14102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:26.316674 14102 hybrid_clock.cc:648] HybridClock initialized: now 1786178846316629 us; error 57 us; skew 500 ppm
I20260808 08:47:26.316967 14102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:26 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178846, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:26.319861 14102 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:26.321226 14102 webserver.cc:460] Webserver started at http://127.8.149.65:44141/ using document root <none> and password file <none>
I20260808 08:47:26.321856 14102 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:26.322007 14102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:26.322309 14102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:26.325065 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "240feed7e49d4dde806eda2638ac7087"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "61061f90e916e995f480b1e7f863b0d1"
server_key_iv: "9d6d49d380660375a75ef8bea380feca"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.325870 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "240feed7e49d4dde806eda2638ac7087"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "61061f90e916e995f480b1e7f863b0d1"
server_key_iv: "9d6d49d380660375a75ef8bea380feca"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.330662 14102 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:47:26.334159 14126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.335773 14102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:47:26.335937 14102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "240feed7e49d4dde806eda2638ac7087"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "61061f90e916e995f480b1e7f863b0d1"
server_key_iv: "9d6d49d380660375a75ef8bea380feca"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.336205 14102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:26.349308 14102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:26.352901 14102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:26.353189 14102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:26.354050 14102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:26.355278 14102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:26.355376 14102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.355520 14102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:26.355584 14102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.388734 14102 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:38793
I20260808 08:47:26.388795 14318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:38793 every 8 connection(s)
I20260808 08:47:26.389968 14102 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:26.398602 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14102
I20260808 08:47:26.398818 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:26.399596 8789 external_mini_cluster.cc:1428] Setting key 4b2c35bac33cc3bfdeaa9bcdd2499afb
Aug 08 08:47:26 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178846, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:26.411177 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:26.392440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:34781 (local address 127.8.149.126:40721)
0808 08:47:26.392845 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:26.392849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:26.393798 (+ 949us) server_negotiation.cc:407] Connection header received
0808 08:47:26.395564 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:26.395568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:26.395634 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:26.395729 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:26.397298 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.398011 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.400477 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.401051 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.401176 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:26.405555 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:26.405560 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:26.405563 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:26.405595 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:26.408245 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:26.408971 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:26.408979 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:26.408986 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:26.409108 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:26.409581 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:26.409587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:26.409590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:26.409861 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:26.410024 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:26.410617 (+ 593us) server_negotiation.cc:299] Negotiation successful
0808 08:47:26.410840 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":203,"threads_started":1}
I20260808 08:47:26.412081 14324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:26.392973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40721 (local address 127.8.149.65:34781)
0808 08:47:26.393624 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:26.393661 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:26.395318 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:26.395956 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:26.395964 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:26.396590 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:26.397138 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:26.397155 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.398191 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.398197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:26.400323 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:26.400336 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.401309 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.401315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:26.401545 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:26.402349 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:26.402403 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:26.405329 (+ 2926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:26.408372 (+ 3043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:26.408380 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:26.408392 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:26.408831 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:26.409227 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:26.409232 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:26.409235 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:26.409434 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:26.409989 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:26.409996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:26.410288 (+ 292us) client_negotiation.cc:769] Sending connection context
0808 08:47:26.410531 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 08:47:26.410992 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":243,"threads_started":1}
I20260808 08:47:26.413782 14320 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40721
I20260808 08:47:26.414137 14320 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:26.414815 14320 heartbeater.cc:511] Master 127.8.149.126:40721 requested a full tablet report, sending...
I20260808 08:47:26.417279 13989 ts_manager.cc:194] Registered new tserver with Master: 240feed7e49d4dde806eda2638ac7087 (127.8.149.65:38793)
I20260808 08:47:26.419911 13989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:34781
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:26.455149 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:26.769529 14330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:26.769791 14330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:26.769872 14330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:26.777145 14330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:26.777271 14330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:26.777426 14330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:26.791494 14330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:26.793020 14330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:26.794607 14330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:26.807677 14337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:26.807704 14338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:26.807647 14341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:26.808537 14330 server_base.cc:1034] running on GCE node
I20260808 08:47:26.809090 14330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:26.809914 14330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:26.811131 14330 hybrid_clock.cc:648] HybridClock initialized: now 1786178846811099 us; error 41 us; skew 500 ppm
I20260808 08:47:26.811507 14330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:26 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178846, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:26.814594 14330 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:26.815902 14330 webserver.cc:460] Webserver started at http://127.8.149.66:36165/ using document root <none> and password file <none>
I20260808 08:47:26.816577 14330 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:26.816718 14330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:26.817003 14330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:26.819789 14330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "a00de5f015a3482da7afb1413964f0eb"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "84acfdf98fad9f8072da9bcbc1c2c0b0"
server_key_iv: "d7e474402a76d97643d0326578854322"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.820609 14330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "a00de5f015a3482da7afb1413964f0eb"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "84acfdf98fad9f8072da9bcbc1c2c0b0"
server_key_iv: "d7e474402a76d97643d0326578854322"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.825902 14330 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 08:47:26.829198 14353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.830437 14330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:26.830597 14330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "a00de5f015a3482da7afb1413964f0eb"
format_stamp: "Formatted at 2026-08-08 08:47:26 on dist-test-slave-7vjv"
server_key: "84acfdf98fad9f8072da9bcbc1c2c0b0"
server_key_iv: "d7e474402a76d97643d0326578854322"
server_key_version: "encryptionkey@0"
I20260808 08:47:26.830829 14330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:26.846788 14330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:26.850706 14330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:26.850997 14330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:26.851938 14330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:26.853255 14330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:26.853327 14330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.853540 14330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:26.853593 14330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:26.885207 14330 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:34751
I20260808 08:47:26.885252 14535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:34751 every 8 connection(s)
I20260808 08:47:26.886425 14330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:26.893255 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14330
I20260808 08:47:26.893440 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:26.893940 8789 external_mini_cluster.cc:1428] Setting key ae86d7d3a587b5aa58f0b1e1ebe8ea9a
Aug 08 08:47:26 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178846, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:26.907356 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:26.888909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:47115 (local address 127.8.149.126:40721)
0808 08:47:26.889081 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:26.889086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:26.890208 (+ 1122us) server_negotiation.cc:407] Connection header received
0808 08:47:26.891828 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:26.891832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:26.891895 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:26.891980 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:26.893632 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.894389 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.896501 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.897264 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.897412 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:26.900807 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:26.900815 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:26.900823 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:26.900878 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:26.904296 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:26.905222 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:26.905225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:26.905227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:26.905350 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:26.905812 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:26.905815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:26.905817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:26.906064 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:26.906168 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:26.906965 (+ 797us) server_negotiation.cc:299] Negotiation successful
0808 08:47:26.907123 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:47:26.908810 14540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:26.889386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40721 (local address 127.8.149.66:47115)
0808 08:47:26.890046 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:26.890080 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:26.891600 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:26.892212 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:26.892219 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:26.892717 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:26.893464 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:26.893490 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.894577 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.894582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:26.896341 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:26.896352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:26.897502 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:26.897507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:26.897695 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:26.898421 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:26.898447 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:26.900610 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:26.904425 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:26.904437 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:26.904451 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:26.905106 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:26.905459 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:26.905465 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:26.905468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:26.905702 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:26.906185 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:26.906196 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:26.906596 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 08:47:26.906871 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 08:47:26.907400 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":250,"threads_started":1}
I20260808 08:47:26.910101 14537 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40721
I20260808 08:47:26.910404 14537 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:26.911059 14537 heartbeater.cc:511] Master 127.8.149.126:40721 requested a full tablet report, sending...
I20260808 08:47:26.912477 13989 ts_manager.cc:194] Registered new tserver with Master: a00de5f015a3482da7afb1413964f0eb (127.8.149.66:34751)
I20260808 08:47:26.913270 13989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:47115
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:26.943185 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:27.257239 14544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:27.257540 14544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:27.257699 14544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:27.264461 14544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:27.264593 14544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:27.264753 14544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:27.273490 14544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:27.274590 14544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:27.275902 14544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:27.288239 14557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:27.288266 14555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:27.288627 14554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:27.288928 14544 server_base.cc:1034] running on GCE node
I20260808 08:47:27.289542 14544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:27.290416 14544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:27.291604 14544 hybrid_clock.cc:648] HybridClock initialized: now 1786178847291574 us; error 32 us; skew 500 ppm
I20260808 08:47:27.291915 14544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:27.295077 14544 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:27.296387 14544 webserver.cc:460] Webserver started at http://127.8.149.67:36161/ using document root <none> and password file <none>
I20260808 08:47:27.296973 14544 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:27.297072 14544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:27.297307 14544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:27.300014 14544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "ee064fc3a41645068ae42b8a6b894fb5"
format_stamp: "Formatted at 2026-08-08 08:47:27 on dist-test-slave-7vjv"
server_key: "f78e3dd418db709698e1c16b6dfb74b1"
server_key_iv: "3104b48be6d218918bbdb14ac9a7650d"
server_key_version: "encryptionkey@0"
I20260808 08:47:27.300825 14544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "ee064fc3a41645068ae42b8a6b894fb5"
format_stamp: "Formatted at 2026-08-08 08:47:27 on dist-test-slave-7vjv"
server_key: "f78e3dd418db709698e1c16b6dfb74b1"
server_key_iv: "3104b48be6d218918bbdb14ac9a7650d"
server_key_version: "encryptionkey@0"
I20260808 08:47:27.305320 14544 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:47:27.308645 14573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:27.309860 14544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:47:27.310017 14544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "ee064fc3a41645068ae42b8a6b894fb5"
format_stamp: "Formatted at 2026-08-08 08:47:27 on dist-test-slave-7vjv"
server_key: "f78e3dd418db709698e1c16b6dfb74b1"
server_key_iv: "3104b48be6d218918bbdb14ac9a7650d"
server_key_version: "encryptionkey@0"
I20260808 08:47:27.310178 14544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:27.338724 14544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:27.343158 14544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:27.343444 14544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:27.344384 14544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:27.345697 14544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:27.345795 14544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:27.345968 14544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:27.346048 14544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:27.380903 14544 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46159
I20260808 08:47:27.380954 14759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46159 every 8 connection(s)
I20260808 08:47:27.382213 14544 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:27.390398 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14544
I20260808 08:47:27.390604 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:27.391198 8789 external_mini_cluster.cc:1428] Setting key dda417fe32f15abcb2cbeb4147d15e9b
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:27.403558 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.384779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:56565 (local address 127.8.149.126:40721)
0808 08:47:27.385046 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:27.385053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:27.386276 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 08:47:27.388056 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:27.388062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:27.388205 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:27.388335 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:27.390333 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.391589 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.393856 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.394519 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.394618 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.397989 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:27.397993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:27.397996 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:27.398026 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:27.400755 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.401453 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.401456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.401459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.401582 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.402009 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.402012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.402014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.402261 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:27.402371 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:27.403157 (+ 786us) server_negotiation.cc:299] Negotiation successful
0808 08:47:27.403310 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:47:27.404531 14764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.385384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40721 (local address 127.8.149.67:56565)
0808 08:47:27.386101 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:27.386145 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:27.387712 (+ 1567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:27.388607 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:27.388617 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:27.389359 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:27.390141 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:27.390164 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.391761 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.391766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:27.393703 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:27.393717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.394716 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.394721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:27.394918 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.395576 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:27.395597 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:27.397793 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:27.400889 (+ 3096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:27.400896 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:27.400906 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:27.401335 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:27.401683 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:27.401686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:27.401689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:27.401911 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:27.402369 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:27.402376 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:27.402709 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 08:47:27.403087 (+ 378us) client_negotiation.cc:240] Negotiation successful
0808 08:47:27.403455 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":268,"threads_started":1}
I20260808 08:47:27.405930 14761 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40721
I20260808 08:47:27.406260 14761 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:27.407011 14761 heartbeater.cc:511] Master 127.8.149.126:40721 requested a full tablet report, sending...
I20260808 08:47:27.408398 13988 ts_manager.cc:194] Registered new tserver with Master: ee064fc3a41645068ae42b8a6b894fb5 (127.8.149.67:46159)
I20260808 08:47:27.409214 13988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:56565
I20260808 08:47:27.418921 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:27.422873 14320 heartbeater.cc:503] Master 127.8.149.126:40721 was elected leader, sending a full tablet report...
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:27.472059 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.458711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60572 (local address 127.8.149.126:40721)
0808 08:47:27.458929 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:27.458937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:27.459420 (+ 483us) server_negotiation.cc:407] Connection header received
0808 08:47:27.459574 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:27.459577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:27.459654 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:27.459765 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:27.461228 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.461976 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.463172 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.463582 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.463679 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.467421 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:27.467425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:27.467429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:27.467459 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:27.469890 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.470425 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.470429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.470431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.470549 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.470880 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.470884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.470887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.471182 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:27.471357 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:27.471576 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 08:47:27.471742 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:47:27.472594 13988 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60572
I20260808 08:47:27.474666 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14102
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:27.493736 14779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.475666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58074 (local address 127.8.149.65:38793)
0808 08:47:27.476299 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:27.476305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:27.476328 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:27.476378 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:27.476384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:27.476593 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:27.476754 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:27.477863 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.478807 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.479995 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.480766 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.480998 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.486069 (+ 5071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:27.486082 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:27.486096 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:27.486135 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:27.489638 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.490808 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.490822 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.490825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.491000 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.491438 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.491445 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.491448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.492043 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:27.492498 (+ 455us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:27.492806 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:47:27.493090 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":280,"threads_started":1}
W20260808 08:47:27.495059 14312 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58074
W20260808 08:47:27.496192 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14102: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:27.496367 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14102
I20260808 08:47:27.523753 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14330
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:27.541165 14780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.524732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.8.149.66:34751)
0808 08:47:27.525384 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:27.525392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:27.525418 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:47:27.525479 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:27.525485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:27.525691 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:27.525834 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:27.527142 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.528278 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.529597 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.530242 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.530380 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.534967 (+ 4587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:27.534978 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:27.534990 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:27.535027 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:27.538160 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.538871 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.538878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.538880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.539033 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.539401 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.539405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.539407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.539752 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:27.540045 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:27.540640 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 08:47:27.540847 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":362,"threads_started":1}
W20260808 08:47:27.542428 14530 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59352
W20260808 08:47:27.543460 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14330: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:27.543612 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14330
I20260808 08:47:27.569615 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14544
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[13908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178847, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:27.586019 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:27.570578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.8.149.67:46159)
0808 08:47:27.571225 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:27.571231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:27.571261 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:47:27.571320 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:27.571326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:27.571544 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:27.571668 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:27.573100 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.574158 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.575367 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:27.576324 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:27.576464 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:27.580881 (+ 4417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:27.580892 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:27.580906 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:27.580961 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:27.583533 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.584171 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.584178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.584180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.584295 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:27.584632 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:27.584635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:27.584637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:27.584970 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:27.585202 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:27.585418 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 08:47:27.585603 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":306,"threads_started":1}
W20260808 08:47:27.587303 14752 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51686
W20260808 08:47:27.588732 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14544: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:47:27.588944 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14544
I20260808 08:47:27.617274 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13935
I20260808 08:47:27.618438 14044 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:27.726300 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13935
2026-08-08T08:47:27Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3907 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[14788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[14788](info): set up 2 sockets
Aug 08 08:47:27 dist-test-slave-7vjv krb5kdc[14788](info): commencing operation
krb5kdc: starting...
W20260808 08:47:29.063961 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.004s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:29 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:29.270995 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38723
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:38723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:29.911881 14807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:29.913147 14807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:29.913736 14807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:29.939581 14807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:29.939906 14807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:29.940229 14807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:29.940536 14807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:29.940789 14807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:29.975682 14807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:38723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:29.980974 14807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:29.985395 14807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:30.019397 14815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:30.019460 14818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:30.020277 14813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:30.023532 14807 server_base.cc:1034] running on GCE node
I20260808 08:47:30.026158 14807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:30.038401 14807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:30.042213 14807 hybrid_clock.cc:648] HybridClock initialized: now 1786178850042213 us; error 139 us; skew 500 ppm
I20260808 08:47:30.043192 14807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:30 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178850, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:30.054288 14807 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:30.057644 14807 webserver.cc:460] Webserver started at http://127.8.149.126:45361/ using document root <none> and password file <none>
I20260808 08:47:30.058881 14807 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:30.059055 14807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:30.059544 14807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:30.067118 14807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "b405c705bb824174a6e2b3d723df73f0"
format_stamp: "Formatted at 2026-08-08 08:47:30 on dist-test-slave-7vjv"
server_key: "877334d24e28a08b52d8bd31fda47636"
server_key_iv: "eb0dd99b316019ccc80a4250b3ee7c37"
server_key_version: "encryptionkey@0"
I20260808 08:47:30.069712 14807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "b405c705bb824174a6e2b3d723df73f0"
format_stamp: "Formatted at 2026-08-08 08:47:30 on dist-test-slave-7vjv"
server_key: "877334d24e28a08b52d8bd31fda47636"
server_key_iv: "eb0dd99b316019ccc80a4250b3ee7c37"
server_key_version: "encryptionkey@0"
I20260808 08:47:30.082207 14807 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.011s sys 0.001s
I20260808 08:47:30.089460 14830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:30.091532 14807 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:47:30.091728 14807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "b405c705bb824174a6e2b3d723df73f0"
format_stamp: "Formatted at 2026-08-08 08:47:30 on dist-test-slave-7vjv"
server_key: "877334d24e28a08b52d8bd31fda47636"
server_key_iv: "eb0dd99b316019ccc80a4250b3ee7c37"
server_key_version: "encryptionkey@0"
I20260808 08:47:30.091986 14807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:30.125334 14807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:30.131342 14807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:30.131685 14807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:30.159497 14807 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:38723
I20260808 08:47:30.159703 14912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:38723 every 8 connection(s)
I20260808 08:47:30.161499 14807 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:30.164446 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14807
I20260808 08:47:30.164733 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:30.165724 8789 external_mini_cluster.cc:1428] Setting key ad591ef864028aa178f2971bd78e5c1c
I20260808 08:47:30.166978 14913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:30 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:30.191143 14913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0: Bootstrap starting.
I20260808 08:47:30.196432 14913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:30.198693 14913 log.cc:824] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:30.203853 14913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0: No bootstrap required, opened a new log
I20260808 08:47:30.205986 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:30.168518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47988 (local address 127.8.149.126:38723)
0808 08:47:30.169627 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:30.169646 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:30.169763 (+ 117us) server_negotiation.cc:407] Connection header received
0808 08:47:30.172060 (+ 2297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:30.172148 (+ 88us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:30.172856 (+ 708us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:30.173306 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:30.176560 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:30.179172 (+ 2612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:30.182362 (+ 3190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:30.183657 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:30.184010 (+ 353us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:30.192043 (+ 8033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:30.192065 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:30.192149 (+ 84us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:30.192236 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:30.198768 (+ 6532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:30.200315 (+ 1547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:30.200323 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:30.200328 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:30.200582 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:30.201248 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:30.201267 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:30.201272 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:30.202375 (+ 1103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:30.202777 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:30.203497 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 08:47:30.204251 (+ 754us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":541,"threads_started":1}
I20260808 08:47:30.218355 14913 raft_consensus.cc:348] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } }
I20260808 08:47:30.219055 14913 raft_consensus.cc:374] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:30.219234 14913 raft_consensus.cc:729] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b405c705bb824174a6e2b3d723df73f0, State: Initialized, Role: FOLLOWER
I20260808 08:47:30.220288 14913 consensus_queue.cc:260] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } }
I20260808 08:47:30.220676 14913 raft_consensus.cc:388] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:30.220913 14913 raft_consensus.cc:482] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:30.221192 14913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:30.224879 14913 raft_consensus.cc:504] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } }
I20260808 08:47:30.225922 14913 leader_election.cc:302] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b405c705bb824174a6e2b3d723df73f0; no voters:
I20260808 08:47:30.226972 14913 leader_election.cc:288] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:30.227173 14923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:30.228530 14923 raft_consensus.cc:686] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [term 1 LEADER]: Becoming Leader. State: Replica: b405c705bb824174a6e2b3d723df73f0, State: Running, Role: LEADER
I20260808 08:47:30.229454 14923 consensus_queue.cc:237] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } }
I20260808 08:47:30.230171 14913 sys_catalog.cc:564] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:30.234704 14926 sys_catalog.cc:455] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b405c705bb824174a6e2b3d723df73f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } } }
I20260808 08:47:30.235441 14926 sys_catalog.cc:458] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:30.235242 14927 sys_catalog.cc:455] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b405c705bb824174a6e2b3d723df73f0. Latest consensus state: current_term: 1 leader_uuid: "b405c705bb824174a6e2b3d723df73f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b405c705bb824174a6e2b3d723df73f0" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38723 } } }
I20260808 08:47:30.235708 14927 sys_catalog.cc:458] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:30.236832 14941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:30.244004 14941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:30.259188 14941 catalog_manager.cc:1347] Generated new cluster ID: c825108800f643409428d345390aebde
I20260808 08:47:30.259414 14941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:30.274942 14941 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:30.277982 14941 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:30.299948 14941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b405c705bb824174a6e2b3d723df73f0: Generated new TSK 0
I20260808 08:47:30.301191 14941 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:30.396466 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:31.070986 14959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:31.071233 14959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:31.071317 14959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:31.078150 14959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:31.078248 14959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:31.078351 14959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:31.087682 14959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:31.088912 14959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:31.090153 14959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:31.103319 14966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:31.103338 14970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:31.104074 14967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:31.104504 14959 server_base.cc:1034] running on GCE node
I20260808 08:47:31.105072 14959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:31.105921 14959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:31.107151 14959 hybrid_clock.cc:648] HybridClock initialized: now 1786178851107113 us; error 57 us; skew 500 ppm
I20260808 08:47:31.107457 14959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:31 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178851, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:31.110733 14959 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:31.112201 14959 webserver.cc:460] Webserver started at http://127.8.149.65:42987/ using document root <none> and password file <none>
I20260808 08:47:31.112850 14959 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:31.113035 14959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:31.113355 14959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:31.116190 14959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "d65dbfafad144a0793fe12b54dc7fc49"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "ce680ef223c0d05449d5e16ee2e2b718"
server_key_iv: "eff848c0ecce2f21fb24747b28956061"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.116971 14959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "d65dbfafad144a0793fe12b54dc7fc49"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "ce680ef223c0d05449d5e16ee2e2b718"
server_key_iv: "eff848c0ecce2f21fb24747b28956061"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.121899 14959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:47:31.125475 14982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.126717 14959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:31.126895 14959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "d65dbfafad144a0793fe12b54dc7fc49"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "ce680ef223c0d05449d5e16ee2e2b718"
server_key_iv: "eff848c0ecce2f21fb24747b28956061"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.127112 14959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:31.143918 14959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:31.147915 14959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:31.148244 14959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:31.149189 14959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:31.150511 14959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:31.150622 14959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.150781 14959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:31.150868 14959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.187091 14959 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:41531
I20260808 08:47:31.187130 15170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:41531 every 8 connection(s)
I20260808 08:47:31.188472 14959 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:31.196187 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14959
I20260808 08:47:31.196420 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:31.197129 8789 external_mini_cluster.cc:1428] Setting key e44224d809eafa7e63ffcb44c8c89d32
Aug 08 08:47:31 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178851, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:31.210700 15180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:31.191131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42991 (local address 127.8.149.126:38723)
0808 08:47:31.191700 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:31.191704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:31.192459 (+ 755us) server_negotiation.cc:407] Connection header received
0808 08:47:31.194266 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:31.194271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:31.194362 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:31.194495 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:31.196030 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.197045 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.199148 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.199784 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.199919 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:31.203696 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:31.203705 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:31.203713 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:31.203756 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:31.207486 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:31.208283 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:31.208291 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:31.208297 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:31.208459 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:31.208879 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:31.208887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:31.208893 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:31.209219 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:31.209387 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:31.210074 (+ 687us) server_negotiation.cc:299] Negotiation successful
0808 08:47:31.210304 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":319,"threads_started":1}
I20260808 08:47:31.211587 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:31.191502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38723 (local address 127.8.149.65:42991)
0808 08:47:31.192285 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:31.192334 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:31.193992 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:31.194759 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:31.194767 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:31.195266 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:31.195826 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:31.195844 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.197237 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.197244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:31.198963 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:31.198982 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.199997 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.200002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:31.200361 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:31.201072 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:31.201093 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:31.203452 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:31.207632 (+ 4180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:31.207638 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:31.207648 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:31.208160 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:31.208573 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:31.208576 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:31.208579 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:31.208755 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:31.209361 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:31.209368 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:31.209694 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 08:47:31.209955 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 08:47:31.210452 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":287,"threads_started":1}
I20260808 08:47:31.213192 15172 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38723
I20260808 08:47:31.213526 15172 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:31.214396 15172 heartbeater.cc:511] Master 127.8.149.126:38723 requested a full tablet report, sending...
I20260808 08:47:31.217027 14852 ts_manager.cc:194] Registered new tserver with Master: d65dbfafad144a0793fe12b54dc7fc49 (127.8.149.65:41531)
I20260808 08:47:31.219689 14852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:42991
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:31.253587 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:31.582464 15194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:31.582863 15194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:31.583055 15194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:31.590363 15194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:31.590494 15194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:31.590670 15194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:31.600216 15194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:31.601436 15194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:31.602715 15194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:31.618536 15205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:31.618849 15203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:31.619140 15202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:31.619678 15194 server_base.cc:1034] running on GCE node
I20260808 08:47:31.620397 15194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:31.621325 15194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:31.622560 15194 hybrid_clock.cc:648] HybridClock initialized: now 1786178851622506 us; error 50 us; skew 500 ppm
I20260808 08:47:31.622925 15194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:31 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178851, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:31.626509 15194 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:31.627987 15194 webserver.cc:460] Webserver started at http://127.8.149.66:36767/ using document root <none> and password file <none>
I20260808 08:47:31.628656 15194 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:31.628808 15194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:31.629130 15194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:31.632061 15194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "a7c5cafbeb044f27bceae26763266bf5"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "f3b3e64cf2213fd3f77c457085baec51"
server_key_iv: "3a02d7ce026cc59420b8fcccac958623"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.632920 15194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "a7c5cafbeb044f27bceae26763266bf5"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "f3b3e64cf2213fd3f77c457085baec51"
server_key_iv: "3a02d7ce026cc59420b8fcccac958623"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.638248 15194 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:31.642032 15219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.643324 15194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:31.643518 15194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "a7c5cafbeb044f27bceae26763266bf5"
format_stamp: "Formatted at 2026-08-08 08:47:31 on dist-test-slave-7vjv"
server_key: "f3b3e64cf2213fd3f77c457085baec51"
server_key_iv: "3a02d7ce026cc59420b8fcccac958623"
server_key_version: "encryptionkey@0"
I20260808 08:47:31.643718 15194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:31.677350 15194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:31.681875 15194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:31.682206 15194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:31.683136 15194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:31.684569 15194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:31.684679 15194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.684859 15194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:31.684943 15194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:31.719156 15194 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:43143
I20260808 08:47:31.719249 15405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:43143 every 8 connection(s)
I20260808 08:47:31.720547 15194 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:31.722146 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 15194
I20260808 08:47:31.722368 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:31.722803 8789 external_mini_cluster.cc:1428] Setting key d999cc66d80b15f9dd566f5aaf90c67b
Aug 08 08:47:31 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178851, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:31.744488 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:31.724589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:35773 (local address 127.8.149.126:38723)
0808 08:47:31.725060 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:31.725066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:31.728169 (+ 3103us) server_negotiation.cc:407] Connection header received
0808 08:47:31.728232 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:31.728236 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:31.728296 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:31.728377 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:31.730710 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.731677 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.733649 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.734361 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.734470 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:31.738607 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:31.738611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:31.738615 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:31.738665 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:31.741396 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:31.742153 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:31.742161 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:31.742176 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:31.742308 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:31.742747 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:31.742753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:31.742756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:31.743055 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:31.743247 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:31.743883 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 08:47:31.744122 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":236,"threads_started":1}
I20260808 08:47:31.745375 15414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:31.725271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38723 (local address 127.8.149.66:35773)
0808 08:47:31.726092 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:31.726145 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:31.727841 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:31.728723 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:31.728736 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:31.729609 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:31.730518 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:31.730546 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.731900 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.731906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:31.733477 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:31.733489 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:31.734599 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:31.734607 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:31.734908 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:31.735678 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:31.735718 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:31.738388 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:31.741584 (+ 3196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:31.741592 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:31.741606 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:31.742007 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:31.742425 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:31.742430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:31.742433 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:31.742619 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:31.743218 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:31.743226 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:31.743533 (+ 307us) client_negotiation.cc:769] Sending connection context
0808 08:47:31.743794 (+ 261us) client_negotiation.cc:240] Negotiation successful
0808 08:47:31.744314 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":358,"threads_started":1}
I20260808 08:47:31.746799 15407 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38723
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
I20260808 08:47:31.747128 15407 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:31.747840 15407 heartbeater.cc:511] Master 127.8.149.126:38723 requested a full tablet report, sending...
I20260808 08:47:31.749459 14852 ts_manager.cc:194] Registered new tserver with Master: a7c5cafbeb044f27bceae26763266bf5 (127.8.149.66:43143)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
I20260808 08:47:31.750432 14852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:35773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:31.775499 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:32.098244 15419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:32.098479 15419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:32.098636 15419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:32.105751 15419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:32.105842 15419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:32.105949 15419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:32.114847 15419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38723
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:32.115845 15419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:32.117146 15419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:32.129468 15425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:32.129492 15424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:32.129644 15427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:32.130277 15419 server_base.cc:1034] running on GCE node
I20260808 08:47:32.130857 15419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:32.131704 15419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:32.132885 15419 hybrid_clock.cc:648] HybridClock initialized: now 1786178852132863 us; error 34 us; skew 500 ppm
I20260808 08:47:32.133136 15419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:32.136148 15419 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:32.137655 15419 webserver.cc:460] Webserver started at http://127.8.149.67:33729/ using document root <none> and password file <none>
I20260808 08:47:32.138245 15419 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:32.138348 15419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:32.138631 15419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:32.141722 15419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "a890acffaf3a412b92721d64911857d9"
format_stamp: "Formatted at 2026-08-08 08:47:32 on dist-test-slave-7vjv"
server_key: "23935c7ef30edaf8c4fa4d274c126ef6"
server_key_iv: "ff39c893f3894816e2222d588456a37f"
server_key_version: "encryptionkey@0"
I20260808 08:47:32.142441 15419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "a890acffaf3a412b92721d64911857d9"
format_stamp: "Formatted at 2026-08-08 08:47:32 on dist-test-slave-7vjv"
server_key: "23935c7ef30edaf8c4fa4d274c126ef6"
server_key_iv: "ff39c893f3894816e2222d588456a37f"
server_key_version: "encryptionkey@0"
I20260808 08:47:32.147054 15419 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 08:47:32.150315 15438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:32.151533 15419 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:47:32.151731 15419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "a890acffaf3a412b92721d64911857d9"
format_stamp: "Formatted at 2026-08-08 08:47:32 on dist-test-slave-7vjv"
server_key: "23935c7ef30edaf8c4fa4d274c126ef6"
server_key_iv: "ff39c893f3894816e2222d588456a37f"
server_key_version: "encryptionkey@0"
I20260808 08:47:32.151922 15419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:32.171021 15419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:32.174573 15419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:32.174873 15419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:32.175751 15419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:32.177018 15419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:32.177088 15419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:32.177268 15419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:32.177320 15419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:32.211324 15419 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:41147
I20260808 08:47:32.211472 15617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:41147 every 8 connection(s)
I20260808 08:47:32.212570 15419 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:32.214592 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 15419
I20260808 08:47:32.214790 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:32.215385 8789 external_mini_cluster.cc:1428] Setting key 09b97654d924f0d2eed0670d663844dc
I20260808 08:47:32.223635 15172 heartbeater.cc:503] Master 127.8.149.126:38723 was elected leader, sending a full tablet report...
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:32.232666 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.215234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:48133 (local address 127.8.149.126:38723)
0808 08:47:32.215466 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.215474 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.216845 (+ 1371us) server_negotiation.cc:407] Connection header received
0808 08:47:32.219043 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.219047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.219123 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.219211 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.220706 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.221428 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.222806 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.223226 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.223315 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.226797 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.226801 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.226804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.226833 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.229425 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.230232 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.230236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.230240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.230419 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.230874 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.230879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.230883 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.231156 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.231311 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.232081 (+ 770us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.232336 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:47:32.233496 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.215770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38723 (local address 127.8.149.67:48133)
0808 08:47:32.216662 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:32.216718 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:32.218810 (+ 2092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:32.219414 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:32.219421 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:32.219923 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:32.220549 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:32.220566 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.221560 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.221563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:32.222682 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:32.222693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.223417 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.223422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:32.223596 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.224309 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:32.224335 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:32.226610 (+ 2275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:32.229551 (+ 2941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:32.229560 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:32.229577 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:32.230110 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:32.230537 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:32.230542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:32.230545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:32.230747 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:32.231295 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:32.231302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:32.231697 (+ 395us) client_negotiation.cc:769] Sending connection context
0808 08:47:32.231982 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 08:47:32.232492 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":388,"threads_started":1}
I20260808 08:47:32.234673 15618 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38723
I20260808 08:47:32.234906 15618 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:32.235546 15618 heartbeater.cc:511] Master 127.8.149.126:38723 requested a full tablet report, sending...
I20260808 08:47:32.236869 14852 ts_manager.cc:194] Registered new tserver with Master: a890acffaf3a412b92721d64911857d9 (127.8.149.67:41147)
I20260808 08:47:32.237614 14852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:48133
I20260808 08:47:32.242784 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:32.297258 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.281972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34604 (local address 127.8.149.65:41531)
0808 08:47:32.282690 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.282697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.282726 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:47:32.282788 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.282795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.282999 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.283125 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.284443 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.285502 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.286617 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.287131 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.287225 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.291557 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.291569 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.291593 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.291629 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.294575 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.295221 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.295228 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.295230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.295349 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.295729 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.295732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.295735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.296070 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.296388 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.296654 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.296838 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":333,"threads_started":1}
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:32.315501 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.301787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48004 (local address 127.8.149.126:38723)
0808 08:47:32.301994 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.302001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.302093 (+ 92us) server_negotiation.cc:407] Connection header received
0808 08:47:32.302261 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.302266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.302345 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.302448 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.303557 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.304349 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.305461 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.305836 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.305966 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.309685 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.309692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.309699 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.309738 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.312544 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.313240 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.313247 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.313264 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.313432 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.313878 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.313888 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.313891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.314225 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.314537 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.314908 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.315137 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 08:47:32.316062 14852 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48004
I20260808 08:47:32.317024 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14959
I20260808 08:47:32.329151 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.317984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.8.149.65:41531)
0808 08:47:32.318148 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.318152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.318386 (+ 234us) server_negotiation.cc:407] Connection header received
0808 08:47:32.318501 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.318504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.318556 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.318630 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.319727 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.320459 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.321525 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.321895 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.321981 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.324268 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.324278 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.324282 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.324309 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.326693 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.327330 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.327337 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.327340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.327477 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.327838 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.327843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.327846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.328081 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.328377 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.328690 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.328879 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:47:32.329708 15161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:32.414426 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14959
I20260808 08:47:32.440577 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 15194
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:32.456328 15634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.441531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39936 (local address 127.8.149.66:43143)
0808 08:47:32.442058 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.442065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.442091 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:47:32.442149 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.442155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.442355 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.442547 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.443699 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.444729 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.445941 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.446444 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.446608 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.450691 (+ 4083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.450701 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.450713 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.450746 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.453466 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.454108 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.454115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.454118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.454246 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.454624 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.454629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.454634 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.454951 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.455256 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.455582 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.455849 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":241,"threads_started":1}
I20260808 08:47:32.457542 15399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:32.539750 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 15194
I20260808 08:47:32.564646 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 15419
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[14788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:32.581897 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:32.565780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38870 (local address 127.8.149.67:41147)
0808 08:47:32.566493 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:32.566500 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:32.566529 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:47:32.566592 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:32.566599 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:32.566813 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:32.566957 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:32.568480 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.569496 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.570889 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:32.571427 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:32.571518 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:32.576011 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:32.576021 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:32.576035 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:32.576071 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:32.578987 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.579819 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.579826 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.579828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.579974 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:32.580417 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:32.580421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:32.580423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:32.580763 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:32.581027 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:32.581298 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 08:47:32.581577 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":397,"threads_started":1}
I20260808 08:47:32.583176 15611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:32.666649 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 15419
I20260808 08:47:32.692438 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14807
I20260808 08:47:32.693846 14907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:32.797238 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14807
2026-08-08T08:47:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (5071 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[15643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[15643](info): set up 2 sockets
Aug 08 08:47:32 dist-test-slave-7vjv krb5kdc[15643](info): commencing operation
krb5kdc: starting...
W20260808 08:47:34.133981 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:34 dist-test-slave-7vjv krb5kdc[15643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:34.342337 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33613
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:33613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:34.666128 15664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:34.666396 15664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:34.666575 15664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:34.673138 15664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:34.673231 15664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:34.673318 15664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:34.673437 15664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:34.673518 15664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:34.682844 15664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:33613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:34.684057 15664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:34.685460 15664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:34.696148 15674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:34.696122 15683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:34.696260 15677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:34.697691 15664 server_base.cc:1034] running on GCE node
I20260808 08:47:34.698414 15664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:34.699631 15664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:34.700889 15664 hybrid_clock.cc:648] HybridClock initialized: now 1786178854700817 us; error 43 us; skew 500 ppm
I20260808 08:47:34.701273 15664 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:34 dist-test-slave-7vjv krb5kdc[15643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:34.704618 15664 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:34.705740 15664 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:34.705827 15664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:34.706189 15664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:34.709086 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "07db697b6dec4018aaa818d670feac89"
format_stamp: "Formatted at 2026-08-08 08:47:34 on dist-test-slave-7vjv"
server_key: "bd7da34730f00774ab472fcf9adc971d"
server_key_iv: "6c2c6b999376df255f73ad37c766e063"
server_key_version: "encryptionkey@0"
I20260808 08:47:34.709923 15664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "07db697b6dec4018aaa818d670feac89"
format_stamp: "Formatted at 2026-08-08 08:47:34 on dist-test-slave-7vjv"
server_key: "bd7da34730f00774ab472fcf9adc971d"
server_key_iv: "6c2c6b999376df255f73ad37c766e063"
server_key_version: "encryptionkey@0"
I20260808 08:47:34.714740 15664 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 08:47:34.718132 15693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:34.719342 15664 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:47:34.719547 15664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "07db697b6dec4018aaa818d670feac89"
format_stamp: "Formatted at 2026-08-08 08:47:34 on dist-test-slave-7vjv"
server_key: "bd7da34730f00774ab472fcf9adc971d"
server_key_iv: "6c2c6b999376df255f73ad37c766e063"
server_key_version: "encryptionkey@0"
I20260808 08:47:34.719772 15664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:34.742950 15664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:34.746837 15664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:34.747082 15664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:34.764816 15664 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:33613
I20260808 08:47:34.764842 15766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:33613 every 8 connection(s)
I20260808 08:47:34.765690 15664 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:34.769207 15767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:34.773017 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 15664
I20260808 08:47:34.773247 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:34.773838 8789 external_mini_cluster.cc:1428] Setting key 9757896d1ada2d5e816d05e5b0f6bd37
I20260808 08:47:34.780735 15767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: Bootstrap starting.
I20260808 08:47:34.784508 15767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:34.785754 15767 log.cc:824] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:34.789543 15767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: No bootstrap required, opened a new log
Aug 08 08:47:34 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:34.797017 15767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } }
I20260808 08:47:34.797367 15767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:34.797488 15767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07db697b6dec4018aaa818d670feac89, State: Initialized, Role: FOLLOWER
I20260808 08:47:34.797616 15775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:34.775677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.8.149.126:33613)
0808 08:47:34.776529 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:34.776552 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:34.776604 (+ 52us) server_negotiation.cc:407] Connection header received
0808 08:47:34.779076 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:34.779101 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:34.779533 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:34.779951 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:34.781374 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:34.783345 (+ 1971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:34.785093 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:34.786024 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:34.786161 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:34.790838 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:34.790845 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:34.790860 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:34.790905 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:34.793825 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:34.794491 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:34.794497 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:34.794502 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:34.794672 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:34.795048 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:34.795057 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:34.795059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:34.795548 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:34.795874 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:34.796325 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 08:47:34.796677 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":392,"threads_started":1}
I20260808 08:47:34.798069 15767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } }
I20260808 08:47:34.798319 15767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:34.798458 15767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:34.798637 15767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:34.801052 15767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } }
I20260808 08:47:34.801606 15767 leader_election.cc:302] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07db697b6dec4018aaa818d670feac89; no voters:
I20260808 08:47:34.802237 15767 leader_election.cc:288] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:34.802350 15778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:34.803155 15778 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [term 1 LEADER]: Becoming Leader. State: Replica: 07db697b6dec4018aaa818d670feac89, State: Running, Role: LEADER
I20260808 08:47:34.803684 15778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } }
I20260808 08:47:34.804399 15767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:34.806527 15780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07db697b6dec4018aaa818d670feac89. Latest consensus state: current_term: 1 leader_uuid: "07db697b6dec4018aaa818d670feac89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } } }
I20260808 08:47:34.806977 15780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:34.807631 15779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07db697b6dec4018aaa818d670feac89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07db697b6dec4018aaa818d670feac89" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33613 } } }
I20260808 08:47:34.808259 15779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:34.809181 15784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:34.815122 15784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:34.823432 15784 catalog_manager.cc:1347] Generated new cluster ID: 5b1957d2b011442c94d19bbf65dcb9c5
I20260808 08:47:34.823539 15784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:34.869837 15784 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:34.871073 15784 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:34.880007 15784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: Generated new TSK 0
I20260808 08:47:34.880822 15784 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:34.941259 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:35.260833 15806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:35.261094 15806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:35.261188 15806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:35.267875 15806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:35.267966 15806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:35.268067 15806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:35.278188 15806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:35.279428 15806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:35.280928 15806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:35.294353 15819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:35.294409 15815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:35.294618 15814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:35.295548 15806 server_base.cc:1034] running on GCE node
I20260808 08:47:35.296296 15806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:35.297165 15806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:35.298425 15806 hybrid_clock.cc:648] HybridClock initialized: now 1786178855298359 us; error 46 us; skew 500 ppm
I20260808 08:47:35.298797 15806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:35 dist-test-slave-7vjv krb5kdc[15643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178855, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:35.306542 15806 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:35.307741 15806 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:35.307925 15806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:35.308362 15806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:35.311369 15806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "864d255c8b924f6eab62ffecccdb0c20"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "60161f743381a9e37c79e43f448ba80a"
server_key_iv: "2bb1d6fb876d72be71f075f117e1a9f6"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.312307 15806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "864d255c8b924f6eab62ffecccdb0c20"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "60161f743381a9e37c79e43f448ba80a"
server_key_iv: "2bb1d6fb876d72be71f075f117e1a9f6"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.317536 15806 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:47:35.321242 15831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.322646 15806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:35.322806 15806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "864d255c8b924f6eab62ffecccdb0c20"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "60161f743381a9e37c79e43f448ba80a"
server_key_iv: "2bb1d6fb876d72be71f075f117e1a9f6"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.323037 15806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:35.334501 15806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:35.339128 15806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:35.339351 15806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:35.340337 15806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:35.341666 15806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:35.341756 15806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.341827 15806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:35.341894 15806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.378142 15806 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:35273
I20260808 08:47:35.378232 16010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:35273 every 8 connection(s)
I20260808 08:47:35.379062 15806 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:35.381894 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 15806
I20260808 08:47:35.382129 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:35.383069 8789 external_mini_cluster.cc:1428] Setting key 4a3c355e19ab83c95653ce156ea18220
Aug 08 08:47:35 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178855, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:35.399909 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:35.381586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:57475 (local address 127.8.149.126:33613)
0808 08:47:35.382037 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:35.382046 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:35.383319 (+ 1273us) server_negotiation.cc:407] Connection header received
0808 08:47:35.385631 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:35.385636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:35.385733 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:35.385847 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:35.387333 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.388034 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.389585 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.389975 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.390109 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:35.393672 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:35.393677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:35.393680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:35.393713 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:35.396611 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:35.397521 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:35.397525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:35.397528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:35.397648 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:35.398100 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:35.398103 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:35.398105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:35.398370 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:35.398517 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:35.399456 (+ 939us) server_negotiation.cc:299] Negotiation successful
0808 08:47:35.399637 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":240,"threads_started":1}
I20260808 08:47:35.401257 16017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:35.382321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33613 (local address 127.8.149.65:57475)
0808 08:47:35.383114 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:35.383186 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:35.385374 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:35.386115 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:35.386123 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:35.386633 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:35.387170 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:35.387186 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.388242 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.388248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:35.389425 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:35.389437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.390196 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.390203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:35.390412 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:35.391105 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:35.391129 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:35.393439 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:35.396753 (+ 3314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:35.396765 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:35.396781 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:35.397406 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:35.397757 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:35.397764 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:35.397770 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:35.397991 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:35.398556 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:35.398567 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:35.399057 (+ 490us) client_negotiation.cc:769] Sending connection context
0808 08:47:35.399350 (+ 293us) client_negotiation.cc:240] Negotiation successful
0808 08:47:35.399886 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":319,"threads_started":1}
I20260808 08:47:35.402786 16011 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33613
I20260808 08:47:35.403098 16011 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:35.403898 16011 heartbeater.cc:511] Master 127.8.149.126:33613 requested a full tablet report, sending...
I20260808 08:47:35.406231 15719 ts_manager.cc:194] Registered new tserver with Master: 864d255c8b924f6eab62ffecccdb0c20 (127.8.149.65:35273)
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
I20260808 08:47:35.407747 15719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:57475
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:35.435876 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:35.751369 16021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:35.751747 16021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:35.751955 16021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:35.759016 16021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:35.759106 16021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:35.759212 16021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:35.768028 16021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:35.769205 16021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:35.770438 16021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:35.782907 16031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:35.783443 16032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:35.783672 16036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:35.784435 16021 server_base.cc:1034] running on GCE node
I20260808 08:47:35.785003 16021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:35.785912 16021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:35.787138 16021 hybrid_clock.cc:648] HybridClock initialized: now 1786178855787081 us; error 48 us; skew 500 ppm
I20260808 08:47:35.787415 16021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:35 dist-test-slave-7vjv krb5kdc[15643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178855, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:35.790599 16021 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:35.791608 16021 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:35.791694 16021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:35.791941 16021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:35.794647 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "f4ad837eebb54471843b132781d83587"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "1a5058be4871100b7d20d3c72265c87d"
server_key_iv: "e53bb5bf26c5a336608b01d80ea0dda3"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.795382 16021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "f4ad837eebb54471843b132781d83587"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "1a5058be4871100b7d20d3c72265c87d"
server_key_iv: "e53bb5bf26c5a336608b01d80ea0dda3"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.799980 16021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260808 08:47:35.803299 16045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.804629 16021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:35.804772 16021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "f4ad837eebb54471843b132781d83587"
format_stamp: "Formatted at 2026-08-08 08:47:35 on dist-test-slave-7vjv"
server_key: "1a5058be4871100b7d20d3c72265c87d"
server_key_iv: "e53bb5bf26c5a336608b01d80ea0dda3"
server_key_version: "encryptionkey@0"
I20260808 08:47:35.805065 16021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:35.826110 16021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:35.830545 16021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:35.830766 16021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:35.831660 16021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:35.832983 16021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:35.833089 16021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.833283 16021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:35.833395 16021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:35.867189 16021 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:34819
I20260808 08:47:35.867296 16234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:34819 every 8 connection(s)
I20260808 08:47:35.868165 16021 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:35.874027 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 16021
I20260808 08:47:35.874221 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:35.874663 8789 external_mini_cluster.cc:1428] Setting key 307a7294625b3a21570af9ed084fe257
Aug 08 08:47:35 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178855, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:35.889895 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:35.870559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:37519 (local address 127.8.149.126:33613)
0808 08:47:35.870752 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:35.870756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:35.871686 (+ 930us) server_negotiation.cc:407] Connection header received
0808 08:47:35.873551 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:35.873556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:35.873668 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:35.873786 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:35.875531 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.876742 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.878276 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.879195 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.879368 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:35.883634 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:35.883639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:35.883642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:35.883672 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:35.886349 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:35.887299 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:35.887305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:35.887309 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:35.887504 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:35.887993 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:35.888001 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:35.888007 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:35.888414 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:35.888564 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:35.889185 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 08:47:35.889454 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:47:35.890614 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:35.870864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33613 (local address 127.8.149.66:37519)
0808 08:47:35.871524 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:35.871572 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:35.873295 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:35.874006 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:35.874013 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:35.874642 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:35.875305 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:35.875332 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.876940 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.876943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:35.878111 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:35.878122 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:35.879410 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:35.879414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:35.879579 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:35.880367 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:35.880400 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:35.883369 (+ 2969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:35.886521 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:35.886528 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:35.886539 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:35.887171 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:35.887666 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:35.887670 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:35.887672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:35.887841 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:35.888540 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:35.888545 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:35.888813 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 08:47:35.889063 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 08:47:35.889562 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":272,"threads_started":1}
I20260808 08:47:35.892045 16235 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33613
I20260808 08:47:35.892385 16235 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:35.893150 16235 heartbeater.cc:511] Master 127.8.149.126:33613 requested a full tablet report, sending...
I20260808 08:47:35.894752 15719 ts_manager.cc:194] Registered new tserver with Master: f4ad837eebb54471843b132781d83587 (127.8.149.66:34819)
I20260808 08:47:35.895526 15719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:37519
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:35.927711 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:36.242304 16244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:36.242588 16244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:36.242743 16244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:36.249595 16244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:36.249722 16244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:36.249897 16244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:36.259063 16244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33613
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:36.260284 16244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:36.261590 16244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:36.273665 16257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:36.273746 16255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:36.273777 16253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:36.274691 16244 server_base.cc:1034] running on GCE node
I20260808 08:47:36.275285 16244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:36.276274 16244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:36.277491 16244 hybrid_clock.cc:648] HybridClock initialized: now 1786178856277443 us; error 44 us; skew 500 ppm
I20260808 08:47:36.277793 16244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:36 dist-test-slave-7vjv krb5kdc[15643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178856, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:36.280972 16244 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:36.282112 16244 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:36.282256 16244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:36.282569 16244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:36.285377 16244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "fcee5cea8f064698b9e9507a14493a2c"
format_stamp: "Formatted at 2026-08-08 08:47:36 on dist-test-slave-7vjv"
server_key: "6a1b28597ccb862f7d4ed616f27405ce"
server_key_iv: "43b8440c3455cf51d12645c3fd985805"
server_key_version: "encryptionkey@0"
I20260808 08:47:36.286165 16244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "fcee5cea8f064698b9e9507a14493a2c"
format_stamp: "Formatted at 2026-08-08 08:47:36 on dist-test-slave-7vjv"
server_key: "6a1b28597ccb862f7d4ed616f27405ce"
server_key_iv: "43b8440c3455cf51d12645c3fd985805"
server_key_version: "encryptionkey@0"
I20260808 08:47:36.291124 16244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:47:36.294631 16265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:36.295972 16244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:36.296197 16244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "fcee5cea8f064698b9e9507a14493a2c"
format_stamp: "Formatted at 2026-08-08 08:47:36 on dist-test-slave-7vjv"
server_key: "6a1b28597ccb862f7d4ed616f27405ce"
server_key_iv: "43b8440c3455cf51d12645c3fd985805"
server_key_version: "encryptionkey@0"
I20260808 08:47:36.296481 16244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:36.306066 16244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:36.309877 16244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:36.310073 16244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:36.310946 16244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:36.312211 16244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:36.312295 16244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:36.312366 16244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:36.312418 16244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:36.350363 16244 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46649
I20260808 08:47:36.350445 16441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46649 every 8 connection(s)
I20260808 08:47:36.351218 16244 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:36.355646 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 16244
I20260808 08:47:36.355841 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:36.356341 8789 external_mini_cluster.cc:1428] Setting key 4031027356e1ac055764fc3cd85e2fe4
Aug 08 08:47:36 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178856, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:36.370105 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.353672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:34339 (local address 127.8.149.126:33613)
0808 08:47:36.353845 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.353849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.354955 (+ 1106us) server_negotiation.cc:407] Connection header received
0808 08:47:36.356962 (+ 2007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.356968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.357100 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.357211 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:36.358603 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.359401 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.361004 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.361413 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.361544 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.364761 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:36.364766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:36.364769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:36.364797 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:36.367209 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.367942 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.367946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.367948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.368064 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.368533 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.368538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.368547 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.368798 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:36.368961 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.369547 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.369758 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:47:36.371184 16445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.354101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33613 (local address 127.8.149.67:34339)
0808 08:47:36.354783 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.354826 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.356705 (+ 1879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.357443 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.357451 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.357936 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:36.358429 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.358444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.359588 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.359592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.360854 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.360867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.361646 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.361653 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.361862 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.362456 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:36.362477 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:36.364559 (+ 2082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:36.367384 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:36.367401 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:36.367414 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:36.367793 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:36.368223 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:36.368228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:36.368232 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:36.368415 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:36.368927 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:36.368934 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:36.369219 (+ 285us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.369463 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.369897 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":279,"threads_started":1}
I20260808 08:47:36.372413 16442 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33613
I20260808 08:47:36.372684 16442 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:36.373272 16442 heartbeater.cc:511] Master 127.8.149.126:33613 requested a full tablet report, sending...
I20260808 08:47:36.374588 15719 ts_manager.cc:194] Registered new tserver with Master: fcee5cea8f064698b9e9507a14493a2c (127.8.149.67:46649)
I20260808 08:47:36.375335 15719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:34339
I20260808 08:47:36.383358 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:36.399578 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.387744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58448 (local address 127.8.149.126:33613)
0808 08:47:36.387934 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.387942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.388553 (+ 611us) server_negotiation.cc:407] Connection header received
0808 08:47:36.388672 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.388676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.388732 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.388808 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:36.390229 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.390886 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.392071 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.392509 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.392602 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.394857 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:36.394861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:36.394864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:36.394889 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:36.397277 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.397846 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.397850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.397852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.397976 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.398276 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.398278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.398280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.398562 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:36.398747 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.399091 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.399290 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:47:36.403514 15719 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:36.410362 15719 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:36.410934 16011 heartbeater.cc:503] Master 127.8.149.126:33613 was elected leader, sending a full tablet report...
I20260808 08:47:36.433691 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.422513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.8.149.67:46649)
0808 08:47:36.423731 (+ 1218us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.423739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.423771 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:47:36.423874 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.423882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.424177 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.425305 (+ 1128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:36.425666 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.427743 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.431265 (+ 3522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.432529 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.432648 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.432854 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.433181 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.433329 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":901,"threads_started":1}
I20260808 08:47:36.433741 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.422143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46649 (local address 127.0.0.1:49178)
0808 08:47:36.422912 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.422949 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.423105 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.424447 (+ 1342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.424457 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.424495 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:36.425039 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.425058 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.428738 (+ 3680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.428746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.431053 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.431070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.432720 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.432726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.432973 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.433011 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.433137 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.433318 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"mutex_wait_us":62,"thread_start_us":389,"threads_started":1}
I20260808 08:47:36.433856 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.423052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37844 (local address 127.8.149.65:35273)
0808 08:47:36.424153 (+ 1101us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.424164 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.424869 (+ 705us) server_negotiation.cc:407] Connection header received
0808 08:47:36.425234 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.425244 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.425507 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.425692 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:36.426785 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.428686 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.431314 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.432532 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.432668 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.432876 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.433411 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.433557 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":898,"thread_start_us":708,"threads_started":1}
I20260808 08:47:36.434685 16471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.422516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35273 (local address 127.0.0.1:37844)
0808 08:47:36.424737 (+ 2221us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.424760 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.425002 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.426005 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.426012 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.426045 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:36.426563 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.426577 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.428867 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.428871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.431145 (+ 2274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.431160 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.433017 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.433023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.433189 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.433224 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.434158 (+ 934us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.434290 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2022,"mutex_wait_us":131,"thread_start_us":5561,"threads_started":1}
I20260808 08:47:36.436919 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.423723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:34819 (local address 127.0.0.1:37884)
0808 08:47:36.428416 (+ 4693us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.428438 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.428565 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.429968 (+ 1403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.429973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.429996 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:36.430463 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.430475 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.432294 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.432299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.434280 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.434293 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.436179 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.436186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.436341 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.436372 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.436467 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.436580 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4544,"thread_start_us":746,"threads_started":1}
I20260808 08:47:36.437031 16472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.424252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37884 (local address 127.8.149.66:34819)
0808 08:47:36.429417 (+ 5165us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.429425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.429450 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:47:36.429538 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.429545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.429750 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.429948 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:36.430673 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.432166 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.434488 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.435936 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.436075 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.436277 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.436531 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.436723 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4965,"thread_start_us":4853,"threads_started":1}
I20260808 08:47:36.437989 16340 tablet_service.cc:1467] Processing CreateTablet for tablet 33f33faac3ae4b3dab79477283ecf534 (DEFAULT_TABLE table=test-table [id=86e9eee05da14116992fafa01c600e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:36.438149 15906 tablet_service.cc:1467] Processing CreateTablet for tablet 33f33faac3ae4b3dab79477283ecf534 (DEFAULT_TABLE table=test-table [id=86e9eee05da14116992fafa01c600e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:36.439574 15906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f33faac3ae4b3dab79477283ecf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:36.439617 16340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f33faac3ae4b3dab79477283ecf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:36.440451 16123 tablet_service.cc:1467] Processing CreateTablet for tablet 33f33faac3ae4b3dab79477283ecf534 (DEFAULT_TABLE table=test-table [id=86e9eee05da14116992fafa01c600e40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:36.441612 16123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f33faac3ae4b3dab79477283ecf534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:36.451061 16474 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Bootstrap starting.
I20260808 08:47:36.453270 16475 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Bootstrap starting.
I20260808 08:47:36.454718 16474 tablet_bootstrap.cc:654] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:36.454921 16476 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Bootstrap starting.
I20260808 08:47:36.456043 16474 log.cc:824] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:36.456947 16475 tablet_bootstrap.cc:654] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:36.458209 16476 tablet_bootstrap.cc:654] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:36.458171 16475 log.cc:824] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:36.459414 16476 log.cc:824] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:36.460058 16474 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: No bootstrap required, opened a new log
I20260808 08:47:36.460367 16474 ts_tablet_manager.cc:1397] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 08:47:36.461269 16475 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: No bootstrap required, opened a new log
I20260808 08:47:36.461592 16475 ts_tablet_manager.cc:1397] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:47:36.461869 16476 tablet_bootstrap.cc:492] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: No bootstrap required, opened a new log
I20260808 08:47:36.462107 16476 ts_tablet_manager.cc:1397] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:47:36.469151 16476 raft_consensus.cc:348] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.469497 16476 raft_consensus.cc:374] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:36.469619 16476 raft_consensus.cc:729] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ad837eebb54471843b132781d83587, State: Initialized, Role: FOLLOWER
I20260808 08:47:36.470189 16476 consensus_queue.cc:260] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.470808 16474 raft_consensus.cc:348] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.471194 16235 heartbeater.cc:503] Master 127.8.149.126:33613 was elected leader, sending a full tablet report...
I20260808 08:47:36.471294 16474 raft_consensus.cc:374] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:36.471439 16474 raft_consensus.cc:729] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcee5cea8f064698b9e9507a14493a2c, State: Initialized, Role: FOLLOWER
I20260808 08:47:36.471855 16476 ts_tablet_manager.cc:1428] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 08:47:36.471588 16475 raft_consensus.cc:348] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.472193 16475 raft_consensus.cc:374] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:36.472302 16475 raft_consensus.cc:729] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 864d255c8b924f6eab62ffecccdb0c20, State: Initialized, Role: FOLLOWER
I20260808 08:47:36.472141 16474 consensus_queue.cc:260] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.473042 16475 consensus_queue.cc:260] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.475082 16475 ts_tablet_manager.cc:1428] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 08:47:36.479059 16442 heartbeater.cc:503] Master 127.8.149.126:33613 was elected leader, sending a full tablet report...
I20260808 08:47:36.480067 16474 ts_tablet_manager.cc:1428] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Time spent starting tablet: real 0.020s user 0.018s sys 0.000s
W20260808 08:47:36.602780 16443 tablet.cc:2369] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:36.620268 16236 tablet.cc:2369] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:36.631462 16012 tablet.cc:2369] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:36.673915 16486 raft_consensus.cc:482] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:36.674217 16486 raft_consensus.cc:504] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.675814 16486 leader_election.cc:288] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 864d255c8b924f6eab62ffecccdb0c20 (127.8.149.65:35273), f4ad837eebb54471843b132781d83587 (127.8.149.66:34819)
I20260808 08:47:36.682832 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.676506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:34277 (local address 127.8.149.65:35273)
0808 08:47:36.676718 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.676725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.676763 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:47:36.676850 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.676914 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.677009 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.677121 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:36.677619 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.678670 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.680676 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.681958 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.682092 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.682148 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.682545 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.682641 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:47:36.682883 16445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.676072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35273 (local address 127.8.149.67:34277)
0808 08:47:36.676428 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.676451 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.676599 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.677177 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.677183 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.677216 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:36.677410 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.677419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.678846 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.678852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.680500 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.680516 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.682117 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.682124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.682314 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.682350 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.682466 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.682603 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260808 08:47:36.683948 16489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.676394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:34819 (local address 127.8.149.67:36647)
0808 08:47:36.677352 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:36.677383 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:36.677491 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:36.677835 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:36.677841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:36.677869 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:36.678249 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.678261 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.679639 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.679643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.681590 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:36.681608 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.683331 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.683340 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:36.683510 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.683555 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 08:47:36.683628 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 08:47:36.683708 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":560,"threads_started":1}
I20260808 08:47:36.684129 16472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.676515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:36647 (local address 127.8.149.66:34819)
0808 08:47:36.676728 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.676735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.677479 (+ 744us) server_negotiation.cc:407] Connection header received
0808 08:47:36.677657 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.677661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.677717 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.677784 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:36.678443 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.679456 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.681788 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.682956 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.683107 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.683192 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.683702 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.683840 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:47:36.684060 15935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f33faac3ae4b3dab79477283ecf534" candidate_uuid: "fcee5cea8f064698b9e9507a14493a2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "864d255c8b924f6eab62ffecccdb0c20" is_pre_election: true
I20260808 08:47:36.684734 15935 raft_consensus.cc:2454] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcee5cea8f064698b9e9507a14493a2c in term 0.
I20260808 08:47:36.685196 16156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f33faac3ae4b3dab79477283ecf534" candidate_uuid: "fcee5cea8f064698b9e9507a14493a2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ad837eebb54471843b132781d83587" is_pre_election: true
I20260808 08:47:36.685513 16269 leader_election.cc:302] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 864d255c8b924f6eab62ffecccdb0c20, fcee5cea8f064698b9e9507a14493a2c; no voters:
I20260808 08:47:36.685812 16156 raft_consensus.cc:2454] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fcee5cea8f064698b9e9507a14493a2c in term 0.
I20260808 08:47:36.685942 16486 raft_consensus.cc:2781] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:36.686125 16486 raft_consensus.cc:482] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:36.686244 16486 raft_consensus.cc:3037] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:36.688586 16486 raft_consensus.cc:504] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.689170 16486 leader_election.cc:288] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [CANDIDATE]: Term 1 election: Requested vote from peers 864d255c8b924f6eab62ffecccdb0c20 (127.8.149.65:35273), f4ad837eebb54471843b132781d83587 (127.8.149.66:34819)
I20260808 08:47:36.689584 15935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f33faac3ae4b3dab79477283ecf534" candidate_uuid: "fcee5cea8f064698b9e9507a14493a2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "864d255c8b924f6eab62ffecccdb0c20"
I20260808 08:47:36.689604 16156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f33faac3ae4b3dab79477283ecf534" candidate_uuid: "fcee5cea8f064698b9e9507a14493a2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ad837eebb54471843b132781d83587"
I20260808 08:47:36.689769 15935 raft_consensus.cc:3037] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:36.689780 16156 raft_consensus.cc:3037] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:36.691886 15935 raft_consensus.cc:2454] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcee5cea8f064698b9e9507a14493a2c in term 1.
I20260808 08:47:36.692297 16269 leader_election.cc:302] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 864d255c8b924f6eab62ffecccdb0c20, fcee5cea8f064698b9e9507a14493a2c; no voters:
I20260808 08:47:36.692327 16156 raft_consensus.cc:2454] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fcee5cea8f064698b9e9507a14493a2c in term 1.
I20260808 08:47:36.692639 16486 raft_consensus.cc:2781] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:36.693123 16486 raft_consensus.cc:686] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 1 LEADER]: Becoming Leader. State: Replica: fcee5cea8f064698b9e9507a14493a2c, State: Running, Role: LEADER
I20260808 08:47:36.693696 16486 consensus_queue.cc:237] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } }
I20260808 08:47:36.698078 15718 catalog_manager.cc:5495] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c reported cstate change: term changed from 0 to 1, leader changed from <none> to fcee5cea8f064698b9e9507a14493a2c (127.8.149.67). New cstate: current_term: 1 leader_uuid: "fcee5cea8f064698b9e9507a14493a2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fcee5cea8f064698b9e9507a14493a2c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:36.730669 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.724608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49194 (local address 127.8.149.67:46649)
0808 08:47:36.724925 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.724932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.725009 (+ 77us) server_negotiation.cc:407] Connection header received
0808 08:47:36.725265 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.725274 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.725348 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.725515 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:36.725942 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.726774 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.728387 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.728811 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.728973 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.729481 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:36.729994 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:36.730167 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.730273 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.730369 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 08:47:36.739249 16156 raft_consensus.cc:1261] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 1 FOLLOWER]: Refusing update from remote peer fcee5cea8f064698b9e9507a14493a2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:36.739279 15935 raft_consensus.cc:1261] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 1 FOLLOWER]: Refusing update from remote peer fcee5cea8f064698b9e9507a14493a2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:36.740381 16490 consensus_queue.cc:1035] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "864d255c8b924f6eab62ffecccdb0c20" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:36.740712 16486 consensus_queue.cc:1035] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ad837eebb54471843b132781d83587" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:36.764472 15719 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:36.764778 15719 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:36.768675 15719 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07db697b6dec4018aaa818d670feac89: Sending DeleteTablet for 3 replicas of tablet 33f33faac3ae4b3dab79477283ecf534
I20260808 08:47:36.769758 16340 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f33faac3ae4b3dab79477283ecf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:36 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:49178
I20260808 08:47:36.770121 16123 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f33faac3ae4b3dab79477283ecf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:36 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:37884
I20260808 08:47:36.770738 15906 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f33faac3ae4b3dab79477283ecf534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:36 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:37844
I20260808 08:47:36.772240 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 15806
I20260808 08:47:36.780982 16510 tablet_replica.cc:330] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: stopping tablet replica
I20260808 08:47:36.781507 16510 raft_consensus.cc:2229] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:36.782119 16510 raft_consensus.cc:2258] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:36.782712 16508 tablet_replica.cc:330] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: stopping tablet replica
I20260808 08:47:36.784569 16508 raft_consensus.cc:2229] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:36.785802 16510 ts_tablet_manager.cc:1905] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:36.786624 16508 raft_consensus.cc:2258] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:36.790695 16508 ts_tablet_manager.cc:1905] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:36.802109 16511 tablet_replica.cc:330] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: stopping tablet replica
I20260808 08:47:36.802536 16511 raft_consensus.cc:2229] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:36.802896 16508 ts_tablet_manager.cc:1918] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:36.803043 16511 raft_consensus.cc:2258] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:36.803076 16508 log.cc:1196] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/33f33faac3ae4b3dab79477283ecf534
I20260808 08:47:36.803570 16508 ts_tablet_manager.cc:1939] T 33f33faac3ae4b3dab79477283ecf534 P fcee5cea8f064698b9e9507a14493a2c: Deleting consensus metadata
I20260808 08:47:36.804400 16510 ts_tablet_manager.cc:1918] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:36.804616 16510 log.cc:1196] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/33f33faac3ae4b3dab79477283ecf534
I20260808 08:47:36.805462 15695 catalog_manager.cc:4841] TS fcee5cea8f064698b9e9507a14493a2c (127.8.149.67:46649): tablet 33f33faac3ae4b3dab79477283ecf534 (table test-table [id=86e9eee05da14116992fafa01c600e40]) successfully deleted
I20260808 08:47:36.806147 16510 ts_tablet_manager.cc:1939] T 33f33faac3ae4b3dab79477283ecf534 P f4ad837eebb54471843b132781d83587: Deleting consensus metadata
I20260808 08:47:36.807901 15694 catalog_manager.cc:4841] TS f4ad837eebb54471843b132781d83587 (127.8.149.66:34819): tablet 33f33faac3ae4b3dab79477283ecf534 (table test-table [id=86e9eee05da14116992fafa01c600e40]) successfully deleted
Aug 08 08:47:36 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:36.809965 16511 ts_tablet_manager.cc:1905] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:36.816373 16511 ts_tablet_manager.cc:1918] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:36.816533 16511 log.cc:1196] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/33f33faac3ae4b3dab79477283ecf534
I20260808 08:47:36.817067 16511 ts_tablet_manager.cc:1939] T 33f33faac3ae4b3dab79477283ecf534 P 864d255c8b924f6eab62ffecccdb0c20: Deleting consensus metadata
I20260808 08:47:36.818699 15697 catalog_manager.cc:4841] TS 864d255c8b924f6eab62ffecccdb0c20 (127.8.149.65:35273): tablet 33f33faac3ae4b3dab79477283ecf534 (table test-table [id=86e9eee05da14116992fafa01c600e40]) successfully deleted
I20260808 08:47:36.819128 16466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.774446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.8.149.65:35273)
0808 08:47:36.774648 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.774656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.789346 (+ 14690us) server_negotiation.cc:407] Connection header received
0808 08:47:36.796418 (+ 7072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.796423 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.796509 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.796589 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:36.798595 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.799821 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.803414 (+ 3593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.804035 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.804156 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.812148 (+ 7992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:36.812161 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:36.812177 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:36.812213 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:36.816002 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.816808 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.816817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.816823 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.816997 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.817416 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.817421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.817424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.817836 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:36.818190 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.818479 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.818699 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:47:36.819734 16001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:36.936395 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 15806
I20260808 08:47:36.966636 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 16021
Aug 08 08:47:36 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:36.985591 16472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:36.967509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37900 (local address 127.8.149.66:34819)
0808 08:47:36.967683 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:36.967687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:36.967756 (+ 69us) server_negotiation.cc:407] Connection header received
0808 08:47:36.967966 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:36.967970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:36.968035 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:36.968281 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:36.969812 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.970570 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.972460 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:36.972867 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:36.972969 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:36.978613 (+ 5644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:36.978632 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:36.978652 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:36.978695 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:36.982690 (+ 3995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.983352 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.983362 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.983366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.983547 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:36.983922 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:36.983927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:36.983930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:36.984471 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:36.984784 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:36.984965 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 08:47:36.985192 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:47:36.986402 16230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:37.080542 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 16021
I20260808 08:47:37.106063 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 16244
Aug 08 08:47:37 dist-test-slave-7vjv krb5kdc[15643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:37.124455 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:37.106864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49206 (local address 127.8.149.67:46649)
0808 08:47:37.107070 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:37.107076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:37.107099 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:37.107184 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:37.107188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:37.107244 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:37.107356 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:37.108649 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:37.109552 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:37.110897 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:37.111351 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:37.111521 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:37.115915 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:37.115932 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:37.115952 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:37.116001 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:37.121254 (+ 5253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:37.121919 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:37.121931 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:37.121935 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:37.122136 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:37.122515 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:37.122523 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:37.122532 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:37.123120 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:37.123503 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:37.123670 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 08:47:37.123947 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:47:37.125304 16437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:37.248284 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 16244
I20260808 08:47:37.277576 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 15664
I20260808 08:47:37.278677 15762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:37.384752 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 15664
2026-08-08T08:47:37Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4586 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T08:47:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:37Z Disabled control of system clock
I20260808 08:47:37.464535 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35695
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:35695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:47:37.776813 16531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:37.777068 16531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:37.777215 16531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:37.783836 16531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:37.783951 16531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:37.784018 16531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:37.784123 16531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:37.784209 16531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:37.792691 16531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:35695
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:37.793749 16531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:37.795325 16531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:37.806552 16543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:37.806532 16549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:37.806622 16542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:37.807274 16531 server_base.cc:1034] running on GCE node
I20260808 08:47:37.808003 16531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:37.809232 16531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:37.810422 16531 hybrid_clock.cc:648] HybridClock initialized: now 1786178857810377 us; error 47 us; skew 500 ppm
I20260808 08:47:37.810747 16531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:37.812863 16531 webserver.cc:460] Webserver started at http://127.8.149.126:35639/ using document root <none> and password file <none>
I20260808 08:47:37.813452 16531 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:37.813553 16531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:37.813906 16531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:37.816648 16531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "1c5014e89fff4e3bade47231ec2932c7"
format_stamp: "Formatted at 2026-08-08 08:47:37 on dist-test-slave-7vjv"
server_key: "fd01a274175b7e4ac88445837606ea5d"
server_key_iv: "7af4eb21a280c7c48024ade2a48ed428"
server_key_version: "encryptionkey@0"
I20260808 08:47:37.817480 16531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "1c5014e89fff4e3bade47231ec2932c7"
format_stamp: "Formatted at 2026-08-08 08:47:37 on dist-test-slave-7vjv"
server_key: "fd01a274175b7e4ac88445837606ea5d"
server_key_iv: "7af4eb21a280c7c48024ade2a48ed428"
server_key_version: "encryptionkey@0"
I20260808 08:47:37.822286 16531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:47:37.825517 16558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:37.826737 16531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:37.826910 16531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "1c5014e89fff4e3bade47231ec2932c7"
format_stamp: "Formatted at 2026-08-08 08:47:37 on dist-test-slave-7vjv"
server_key: "fd01a274175b7e4ac88445837606ea5d"
server_key_iv: "7af4eb21a280c7c48024ade2a48ed428"
server_key_version: "encryptionkey@0"
I20260808 08:47:37.827109 16531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:37.832441 16531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:37.833094 16531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:37.833364 16531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:37.851173 16531 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:35695
I20260808 08:47:37.851243 16635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:35695 every 8 connection(s)
I20260808 08:47:37.852381 16531 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:37.855631 16636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:37.861404 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 16531
I20260808 08:47:37.861609 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:37.862497 8789 external_mini_cluster.cc:1428] Setting key d72b885e3d715460e2ae6fa95c2cc077
I20260808 08:47:37.867640 16636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: Bootstrap starting.
I20260808 08:47:37.873011 16636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:37.873932 16641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:37.864671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40964 (local address 127.8.149.126:35695)
0808 08:47:37.865807 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:37.865822 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:37.865880 (+ 58us) server_negotiation.cc:407] Connection header received
0808 08:47:37.868631 (+ 2751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:37.868657 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:37.869112 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:37.870407 (+ 1295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:37.871351 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:37.871363 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:37.871386 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:37.871409 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:37.871506 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:37.871538 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:37.872271 (+ 733us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:37.872432 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 08:47:37.872735 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":439,"threads_started":1}
I20260808 08:47:37.874646 16636 log.cc:824] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:37.877806 16636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: No bootstrap required, opened a new log
I20260808 08:47:37.885993 16636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } }
I20260808 08:47:37.886334 16636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:37.886445 16636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c5014e89fff4e3bade47231ec2932c7, State: Initialized, Role: FOLLOWER
I20260808 08:47:37.887089 16636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } }
I20260808 08:47:37.887399 16636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:37.887542 16636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:37.887712 16636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:37.890595 16636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } }
I20260808 08:47:37.891155 16636 leader_election.cc:302] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c5014e89fff4e3bade47231ec2932c7; no voters:
I20260808 08:47:37.891776 16636 leader_election.cc:288] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:37.891947 16644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:37.892719 16644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [term 1 LEADER]: Becoming Leader. State: Replica: 1c5014e89fff4e3bade47231ec2932c7, State: Running, Role: LEADER
I20260808 08:47:37.893307 16644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } }
I20260808 08:47:37.893908 16636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:37.896575 16647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c5014e89fff4e3bade47231ec2932c7. Latest consensus state: current_term: 1 leader_uuid: "1c5014e89fff4e3bade47231ec2932c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } } }
I20260808 08:47:37.896970 16647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:37.897472 16646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c5014e89fff4e3bade47231ec2932c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c5014e89fff4e3bade47231ec2932c7" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35695 } } }
I20260808 08:47:37.897887 16646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:37.898759 16655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:37.904592 16655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:37.915961 16655 catalog_manager.cc:1347] Generated new cluster ID: 6d1b585a4cae4e4d94e24a1abfa1c659
I20260808 08:47:37.916070 16655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:37.939419 16655 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:37.939872 16655 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:37.959614 16655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: Generated new TSK 0
I20260808 08:47:37.960491 16655 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:47:37.978058 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--builtin_ntp_servers=127.8.149.84:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:47:38.303798 16684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:38.304032 16684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:38.304216 16684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:38.311091 16684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:38.311177 16684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:38.311383 16684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:38.320194 16684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:38.321275 16684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:38.323045 16684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:38.340188 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:38.340266 16694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:38.340304 16695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:38.342269 16684 server_base.cc:1034] running on GCE node
I20260808 08:47:38.342935 16684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:38.343891 16684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:38.345149 16684 hybrid_clock.cc:648] HybridClock initialized: now 1786178858345108 us; error 53 us; skew 500 ppm
I20260808 08:47:38.345503 16684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:38.347921 16684 webserver.cc:460] Webserver started at http://127.8.149.65:37079/ using document root <none> and password file <none>
I20260808 08:47:38.348687 16684 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:38.348834 16684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:38.349175 16684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:38.352247 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "7fafe733c5004a87b1646ade3317a106"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "795e2c10a9f105a27f5adcb78a06c408"
server_key_iv: "697f7bf00ec641eeb7c242d992fdf6ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.353053 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "7fafe733c5004a87b1646ade3317a106"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "795e2c10a9f105a27f5adcb78a06c408"
server_key_iv: "697f7bf00ec641eeb7c242d992fdf6ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.358101 16684 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:38.361766 16712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.363062 16684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:38.363256 16684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "7fafe733c5004a87b1646ade3317a106"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "795e2c10a9f105a27f5adcb78a06c408"
server_key_iv: "697f7bf00ec641eeb7c242d992fdf6ac"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.363508 16684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:38.369446 16684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:38.370184 16684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:38.370460 16684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:38.371320 16684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:38.372963 16684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:38.373097 16684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.373239 16684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:38.373342 16684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.408350 16684 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:42593
I20260808 08:47:38.408404 16890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:42593 every 8 connection(s)
I20260808 08:47:38.409803 16684 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:38.410279 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 16684
I20260808 08:47:38.410475 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:38.411142 8789 external_mini_cluster.cc:1428] Setting key 5374063a83db2f885570f69da02cee22
I20260808 08:47:38.414254 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--builtin_ntp_servers=127.8.149.84:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:47:38.419997 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:38.412939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:40839 (local address 127.8.149.126:35695)
0808 08:47:38.413429 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:38.413436 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:38.414931 (+ 1495us) server_negotiation.cc:407] Connection header received
0808 08:47:38.417685 (+ 2754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:38.417689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:38.417737 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:38.417833 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:38.419276 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:38.419280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:38.419283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:38.419299 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:38.419354 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:38.419365 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:38.419481 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:38.419722 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 08:47:38.419771 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":241,"threads_started":1}
I20260808 08:47:38.421206 16898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:38.413645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35695 (local address 127.8.149.65:40839)
0808 08:47:38.414749 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:38.414795 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:38.417392 (+ 2597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:38.418095 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:38.418109 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:38.418221 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:38.418935 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:38.418941 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:38.418990 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:38.419101 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:38.419487 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:38.419499 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:38.419517 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 08:47:38.419795 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 08:47:38.420033 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":334,"threads_started":1}
I20260808 08:47:38.422681 16891 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35695
I20260808 08:47:38.422966 16891 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:38.423502 16891 heartbeater.cc:511] Master 127.8.149.126:35695 requested a full tablet report, sending...
I20260808 08:47:38.425458 16587 ts_manager.cc:194] Registered new tserver with Master: 7fafe733c5004a87b1646ade3317a106 (127.8.149.65:42593)
W20260808 08:47:38.734375 16899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:38.734654 16899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:38.734841 16899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:38.743040 16899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:38.743181 16899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:38.743413 16899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:38.752916 16899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:38.754262 16899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:38.756278 16899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:38.770393 16907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:38.770478 16906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:38.770432 16910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:38.771461 16899 server_base.cc:1034] running on GCE node
I20260808 08:47:38.772023 16899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:38.772971 16899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:38.774175 16899 hybrid_clock.cc:648] HybridClock initialized: now 1786178858774122 us; error 49 us; skew 500 ppm
I20260808 08:47:38.774446 16899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:38.776682 16899 webserver.cc:460] Webserver started at http://127.8.149.66:41095/ using document root <none> and password file <none>
I20260808 08:47:38.777349 16899 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:38.777455 16899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:38.777694 16899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:38.780467 16899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "3537610d877948ccac01f902d24c7972"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "38ccce391379bb1e0aa0428a914bb882"
server_key_iv: "7b4c8cbda579450802a3d6e86343dd62"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.781183 16899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "3537610d877948ccac01f902d24c7972"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "38ccce391379bb1e0aa0428a914bb882"
server_key_iv: "7b4c8cbda579450802a3d6e86343dd62"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.785957 16899 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:47:38.789223 16925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.790634 16899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:47:38.790832 16899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "3537610d877948ccac01f902d24c7972"
format_stamp: "Formatted at 2026-08-08 08:47:38 on dist-test-slave-7vjv"
server_key: "38ccce391379bb1e0aa0428a914bb882"
server_key_iv: "7b4c8cbda579450802a3d6e86343dd62"
server_key_version: "encryptionkey@0"
I20260808 08:47:38.791072 16899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:38.796876 16899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:38.797646 16899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:38.797931 16899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:38.798880 16899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:38.800369 16899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:38.800493 16899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.800621 16899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:38.800709 16899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:38.833838 16899 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40379
I20260808 08:47:38.833920 17115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40379 every 8 connection(s)
I20260808 08:47:38.835108 16899 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:38.838173 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 16899
I20260808 08:47:38.838346 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:38.838996 8789 external_mini_cluster.cc:1428] Setting key 12e6e41339539134208a68a0bb6192a8
I20260808 08:47:38.841799 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--builtin_ntp_servers=127.8.149.84:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:47:38.843679 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:38.837582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:43689 (local address 127.8.149.126:35695)
0808 08:47:38.837783 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:38.837789 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:38.839333 (+ 1544us) server_negotiation.cc:407] Connection header received
0808 08:47:38.841450 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:38.841456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:38.841516 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:38.841610 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:38.842954 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:38.842959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:38.842963 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:38.842982 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:38.843017 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:38.843027 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:38.843144 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:38.843358 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 08:47:38.843423 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:47:38.844614 17121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:38.838248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35695 (local address 127.8.149.66:43689)
0808 08:47:38.839195 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:38.839229 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:38.841209 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:38.841831 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:38.841838 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:38.841975 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:38.842677 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:38.842680 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:38.842712 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:38.842785 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:38.843115 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:38.843127 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:38.843134 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:47:38.843430 (+ 296us) client_negotiation.cc:240] Negotiation successful
0808 08:47:38.843655 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":281,"threads_started":1}
I20260808 08:47:38.849891 17116 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35695
I20260808 08:47:38.850211 17116 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:38.850872 17116 heartbeater.cc:511] Master 127.8.149.126:35695 requested a full tablet report, sending...
I20260808 08:47:38.852380 16587 ts_manager.cc:194] Registered new tserver with Master: 3537610d877948ccac01f902d24c7972 (127.8.149.66:40379)
W20260808 08:47:39.171587 17122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:39.171826 17122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:39.171919 17122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:39.178952 17122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:39.179035 17122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:39.179133 17122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:39.187645 17122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:39.188699 17122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:39.190276 17122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:39.203040 17132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:39.203009 17137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:39.202957 17134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:39.203852 17122 server_base.cc:1034] running on GCE node
I20260808 08:47:39.204427 17122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:39.205315 17122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:39.206521 17122 hybrid_clock.cc:648] HybridClock initialized: now 1786178859206478 us; error 42 us; skew 500 ppm
I20260808 08:47:39.206828 17122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:39.209017 17122 webserver.cc:460] Webserver started at http://127.8.149.67:34905/ using document root <none> and password file <none>
I20260808 08:47:39.209649 17122 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:39.209759 17122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:39.210074 17122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:39.212802 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "4c7bde1809354afb91bf9a3db983c042"
format_stamp: "Formatted at 2026-08-08 08:47:39 on dist-test-slave-7vjv"
server_key: "b9cc637c29100cc49cdee6dc999b278d"
server_key_iv: "347197de236dcc18f5be13d52fef33ff"
server_key_version: "encryptionkey@0"
I20260808 08:47:39.213547 17122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "4c7bde1809354afb91bf9a3db983c042"
format_stamp: "Formatted at 2026-08-08 08:47:39 on dist-test-slave-7vjv"
server_key: "b9cc637c29100cc49cdee6dc999b278d"
server_key_iv: "347197de236dcc18f5be13d52fef33ff"
server_key_version: "encryptionkey@0"
I20260808 08:47:39.218463 17122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:47:39.221732 17148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:39.223052 17122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:39.223253 17122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "4c7bde1809354afb91bf9a3db983c042"
format_stamp: "Formatted at 2026-08-08 08:47:39 on dist-test-slave-7vjv"
server_key: "b9cc637c29100cc49cdee6dc999b278d"
server_key_iv: "347197de236dcc18f5be13d52fef33ff"
server_key_version: "encryptionkey@0"
I20260808 08:47:39.223534 17122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:39.229938 17122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:39.230834 17122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:39.231168 17122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:39.232256 17122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:39.233836 17122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:39.233987 17122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:39.234153 17122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:39.234261 17122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:39.268272 17122 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46389
I20260808 08:47:39.268368 17329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46389 every 8 connection(s)
I20260808 08:47:39.269546 17122 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:39.277189 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 17122
I20260808 08:47:39.277241 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.271984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:53217 (local address 127.8.149.126:35695)
0808 08:47:39.272215 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.272221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.273585 (+ 1364us) server_negotiation.cc:407] Connection header received
0808 08:47:39.275168 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.275172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.275234 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.275321 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.276553 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.276557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.276560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.276575 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.276606 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.276617 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.276761 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.276888 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.276960 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:47:39.277361 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:39.277824 8789 external_mini_cluster.cc:1428] Setting key 93e64956033a26eeb6f4ccf6b3b10da7
I20260808 08:47:39.278026 17334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.272576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35695 (local address 127.8.149.67:53217)
0808 08:47:39.273435 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.273477 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.274929 (+ 1452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.275516 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.275523 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.275600 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.276285 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.276288 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.276323 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.276408 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.276704 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.276711 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.276717 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.276915 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.277083 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":264,"threads_started":1}
I20260808 08:47:39.279393 17330 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35695
I20260808 08:47:39.279695 17330 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:39.280364 17330 heartbeater.cc:511] Master 127.8.149.126:35695 requested a full tablet report, sending...
I20260808 08:47:39.281845 16586 ts_manager.cc:194] Registered new tserver with Master: 4c7bde1809354afb91bf9a3db983c042 (127.8.149.67:46389)
I20260808 08:47:39.293484 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:39.301838 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.298923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.8.149.126:35695)
0808 08:47:39.299096 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.299104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.299778 (+ 674us) server_negotiation.cc:407] Connection header received
0808 08:47:39.299930 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.299934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.299979 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.300070 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.301292 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.301296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.301299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.301313 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.301339 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.301349 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.301451 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.301483 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.301521 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:47:39.305763 16586 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:39.313623 16586 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:39.332079 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.325731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46389 (local address 127.0.0.1:45688)
0808 08:47:39.326575 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.326624 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.326774 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.328459 (+ 1685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.328471 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.328573 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.329432 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.329437 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.329465 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.329541 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.331150 (+ 1609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.331165 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.331177 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.331345 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.331436 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":434,"threads_started":1}
I20260808 08:47:39.333173 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.325784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45688 (local address 127.8.149.67:46389)
0808 08:47:39.327682 (+ 1898us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.327693 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.327736 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:47:39.327869 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.327893 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.328183 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.329100 (+ 917us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.330886 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.330898 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.330915 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.330936 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.330988 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.331013 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.332601 (+ 1588us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.332674 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.332771 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1696,"thread_start_us":1524,"threads_started":1}
I20260808 08:47:39.335886 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.327001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:42593 (local address 127.0.0.1:48792)
0808 08:47:39.332302 (+ 5301us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.332319 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.332392 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.334420 (+ 2028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.334424 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.334462 (+ 38us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.335102 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.335105 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.335121 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.335168 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.335500 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.335504 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.335509 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.335598 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.335647 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5197,"thread_start_us":6871,"threads_started":1}
I20260808 08:47:39.335999 17358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.327588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.8.149.65:42593)
0808 08:47:39.333861 (+ 6273us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.333899 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.333936 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:47:39.334021 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.334032 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.334252 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.334402 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.335306 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.335313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.335331 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.335344 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.335385 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.335398 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.335545 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.335607 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.335696 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6071,"thread_start_us":5939,"threads_started":1}
I20260808 08:47:39.338593 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.326406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40379 (local address 127.0.0.1:38808)
0808 08:47:39.330110 (+ 3704us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.330134 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.330243 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.336317 (+ 6074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.336322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.336345 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.337011 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.337014 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.337034 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.337077 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.338055 (+ 978us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.338060 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.338064 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.338181 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.338229 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3498,"thread_start_us":670,"threads_started":1}
I20260808 08:47:39.338605 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.327041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38808 (local address 127.8.149.66:40379)
0808 08:47:39.334445 (+ 7404us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.334453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.334478 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:47:39.334547 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.334554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.335147 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.335297 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.337850 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.337856 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.337864 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.337897 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.337937 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.337949 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.338127 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.338195 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.338282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7232,"thread_start_us":7093,"threads_started":1}
I20260808 08:47:39.338168 17226 tablet_service.cc:1467] Processing CreateTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db (DEFAULT_TABLE table=test-table [id=2ed051051fd84579a47d6af44bfe2b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:39.339746 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e5744386cb4dbaad9d7e444e4fc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:39.339578 16780 tablet_service.cc:1467] Processing CreateTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db (DEFAULT_TABLE table=test-table [id=2ed051051fd84579a47d6af44bfe2b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:39.340896 16780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e5744386cb4dbaad9d7e444e4fc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:39.342252 17009 tablet_service.cc:1467] Processing CreateTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db (DEFAULT_TABLE table=test-table [id=2ed051051fd84579a47d6af44bfe2b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:39.343415 17009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e5744386cb4dbaad9d7e444e4fc6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:39.353580 17360 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Bootstrap starting.
I20260808 08:47:39.354509 17363 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Bootstrap starting.
I20260808 08:47:39.356110 17362 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Bootstrap starting.
I20260808 08:47:39.358121 17363 tablet_bootstrap.cc:654] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:39.358659 17362 tablet_bootstrap.cc:654] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:39.358932 17360 tablet_bootstrap.cc:654] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:39.359421 17363 log.cc:824] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:39.359675 17362 log.cc:824] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:39.360138 17360 log.cc:824] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:39.362388 17362 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: No bootstrap required, opened a new log
I20260808 08:47:39.362637 17362 ts_tablet_manager.cc:1397] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:47:39.362701 17363 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: No bootstrap required, opened a new log
I20260808 08:47:39.362917 17360 tablet_bootstrap.cc:492] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: No bootstrap required, opened a new log
I20260808 08:47:39.362950 17363 ts_tablet_manager.cc:1397] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260808 08:47:39.363196 17360 ts_tablet_manager.cc:1397] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260808 08:47:39.369992 17362 raft_consensus.cc:348] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.370342 17362 raft_consensus.cc:374] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:39.370484 17362 raft_consensus.cc:729] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7bde1809354afb91bf9a3db983c042, State: Initialized, Role: FOLLOWER
I20260808 08:47:39.371078 17362 consensus_queue.cc:260] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.372087 17330 heartbeater.cc:503] Master 127.8.149.126:35695 was elected leader, sending a full tablet report...
I20260808 08:47:39.372738 17362 ts_tablet_manager.cc:1428] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260808 08:47:39.373271 17363 raft_consensus.cc:348] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.373682 17363 raft_consensus.cc:374] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:39.373769 17363 raft_consensus.cc:729] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fafe733c5004a87b1646ade3317a106, State: Initialized, Role: FOLLOWER
I20260808 08:47:39.373632 17360 raft_consensus.cc:348] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.374010 17360 raft_consensus.cc:374] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:39.374097 17360 raft_consensus.cc:729] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3537610d877948ccac01f902d24c7972, State: Initialized, Role: FOLLOWER
I20260808 08:47:39.374310 17363 consensus_queue.cc:260] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.374601 17360 consensus_queue.cc:260] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.375715 16891 heartbeater.cc:503] Master 127.8.149.126:35695 was elected leader, sending a full tablet report...
I20260808 08:47:39.376523 17363 ts_tablet_manager.cc:1428] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
I20260808 08:47:39.376828 17116 heartbeater.cc:503] Master 127.8.149.126:35695 was elected leader, sending a full tablet report...
I20260808 08:47:39.377404 17360 ts_tablet_manager.cc:1428] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
W20260808 08:47:39.413200 16892 tablet.cc:2369] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:39.521286 17333 tablet.cc:2369] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:39.587181 17120 tablet.cc:2369] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:39.606153 17370 raft_consensus.cc:482] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:39.606457 17370 raft_consensus.cc:504] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.608217 17370 leader_election.cc:288] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c7bde1809354afb91bf9a3db983c042 (127.8.149.67:46389), 3537610d877948ccac01f902d24c7972 (127.8.149.66:40379)
I20260808 08:47:39.612062 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.608821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:46373 (local address 127.8.149.66:40379)
0808 08:47:39.609007 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.609016 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.609852 (+ 836us) server_negotiation.cc:407] Connection header received
0808 08:47:39.610049 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.610055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.610114 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.610223 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.611431 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.611437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.611440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.611459 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.611496 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.611511 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.611636 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.611748 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.611808 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:47:39.612066 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.608736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:46213 (local address 127.8.149.67:46389)
0808 08:47:39.608957 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.608964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.609961 (+ 997us) server_negotiation.cc:407] Connection header received
0808 08:47:39.610084 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.610089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.610140 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.610231 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.611429 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.611435 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.611439 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.611459 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.611496 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.611511 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.611635 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.611747 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.611807 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:47:39.612407 17374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.608754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46389 (local address 127.8.149.65:46213)
0808 08:47:39.609828 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.609843 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.609979 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.610308 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.610313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.610339 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.611171 (+ 832us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.611174 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.611193 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.611243 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.611616 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.611622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.611627 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.611803 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.611873 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"mutex_wait_us":22,"spinlock_wait_cycles":22400,"thread_start_us":449,"threads_started":1}
I20260808 08:47:39.612733 17375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.608714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40379 (local address 127.8.149.65:46373)
0808 08:47:39.609719 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:39.609741 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:39.609903 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:39.610308 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:39.610313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:39.610339 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:39.611187 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:47:39.611190 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:39.611200 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:47:39.611243 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:39.611616 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:39.611622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:39.611627 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:47:39.611786 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 08:47:39.611854 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"thread_start_us":493,"threads_started":1}
I20260808 08:47:39.613574 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e5744386cb4dbaad9d7e444e4fc6db" candidate_uuid: "7fafe733c5004a87b1646ade3317a106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7bde1809354afb91bf9a3db983c042" is_pre_election: true
I20260808 08:47:39.613729 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e5744386cb4dbaad9d7e444e4fc6db" candidate_uuid: "7fafe733c5004a87b1646ade3317a106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3537610d877948ccac01f902d24c7972" is_pre_election: true
I20260808 08:47:39.614075 17262 raft_consensus.cc:2454] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fafe733c5004a87b1646ade3317a106 in term 0.
I20260808 08:47:39.614355 17042 raft_consensus.cc:2454] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fafe733c5004a87b1646ade3317a106 in term 0.
I20260808 08:47:39.614789 16714 leader_election.cc:302] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7bde1809354afb91bf9a3db983c042, 7fafe733c5004a87b1646ade3317a106; no voters:
I20260808 08:47:39.615274 17370 raft_consensus.cc:2781] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:39.615433 17370 raft_consensus.cc:482] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:39.615540 17370 raft_consensus.cc:3037] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:39.617693 17370 raft_consensus.cc:504] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.618323 17370 leader_election.cc:288] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [CANDIDATE]: Term 1 election: Requested vote from peers 4c7bde1809354afb91bf9a3db983c042 (127.8.149.67:46389), 3537610d877948ccac01f902d24c7972 (127.8.149.66:40379)
I20260808 08:47:39.618753 17262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e5744386cb4dbaad9d7e444e4fc6db" candidate_uuid: "7fafe733c5004a87b1646ade3317a106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7bde1809354afb91bf9a3db983c042"
I20260808 08:47:39.618959 17262 raft_consensus.cc:3037] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:39.618891 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e5744386cb4dbaad9d7e444e4fc6db" candidate_uuid: "7fafe733c5004a87b1646ade3317a106" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3537610d877948ccac01f902d24c7972"
I20260808 08:47:39.619141 17042 raft_consensus.cc:3037] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:39.621282 17262 raft_consensus.cc:2454] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fafe733c5004a87b1646ade3317a106 in term 1.
I20260808 08:47:39.621630 16714 leader_election.cc:302] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7bde1809354afb91bf9a3db983c042, 7fafe733c5004a87b1646ade3317a106; no voters:
I20260808 08:47:39.621624 17042 raft_consensus.cc:2454] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fafe733c5004a87b1646ade3317a106 in term 1.
I20260808 08:47:39.621884 17370 raft_consensus.cc:2781] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:39.622386 17370 raft_consensus.cc:686] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 1 LEADER]: Becoming Leader. State: Replica: 7fafe733c5004a87b1646ade3317a106, State: Running, Role: LEADER
I20260808 08:47:39.622862 17370 consensus_queue.cc:237] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } }
I20260808 08:47:39.627790 16587 catalog_manager.cc:5495] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fafe733c5004a87b1646ade3317a106 (127.8.149.65). New cstate: current_term: 1 leader_uuid: "7fafe733c5004a87b1646ade3317a106" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fafe733c5004a87b1646ade3317a106" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 42593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:39.695783 17358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.693516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.8.149.65:42593)
0808 08:47:39.693686 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.693691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.693810 (+ 119us) server_negotiation.cc:407] Connection header received
0808 08:47:39.694069 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.694073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.694223 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.694312 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.695201 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.695209 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.695215 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.695237 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.695284 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.695297 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.695417 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.695462 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.695507 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:47:39.704031 17262 raft_consensus.cc:1261] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 1 FOLLOWER]: Refusing update from remote peer 7fafe733c5004a87b1646ade3317a106: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:39.704031 17042 raft_consensus.cc:1261] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 1 FOLLOWER]: Refusing update from remote peer 7fafe733c5004a87b1646ade3317a106: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:39.704983 17377 consensus_queue.cc:1035] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3537610d877948ccac01f902d24c7972" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:39.705309 17370 consensus_queue.cc:1035] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c7bde1809354afb91bf9a3db983c042" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:39.716157 17385 mvcc.cc:205] Tried to move back new op lower bound from 7316188609338109952 to 7316188609018802176. Current Snapshot: MvccSnapshot[applied={T|T < 7316188609338109952}]
I20260808 08:47:39.722658 17388 mvcc.cc:205] Tried to move back new op lower bound from 7316188609338109952 to 7316188609018802176. Current Snapshot: MvccSnapshot[applied={T|T < 7316188609338109952}]
I20260808 08:47:39.730036 16587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:39.730322 16587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:39.733834 16587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1c5014e89fff4e3bade47231ec2932c7: Sending DeleteTablet for 3 replicas of tablet 78e5744386cb4dbaad9d7e444e4fc6db
I20260808 08:47:39.734934 17009 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:39 UTC) from {username='slave'} at 127.0.0.1:38808
I20260808 08:47:39.734982 16780 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:39 UTC) from {username='slave'} at 127.0.0.1:48792
I20260808 08:47:39.735651 17226 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e5744386cb4dbaad9d7e444e4fc6db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:39 UTC) from {username='slave'} at 127.0.0.1:45688
I20260808 08:47:39.735802 17404 tablet_replica.cc:330] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: stopping tablet replica
I20260808 08:47:39.735757 17403 tablet_replica.cc:330] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: stopping tablet replica
I20260808 08:47:39.736233 17404 raft_consensus.cc:2229] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:39.736334 17403 raft_consensus.cc:2229] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:39.736493 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 16684
I20260808 08:47:39.736989 17403 raft_consensus.cc:2258] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:39.736997 17404 raft_consensus.cc:2258] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:39.739378 17404 ts_tablet_manager.cc:1905] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:39.739475 17403 ts_tablet_manager.cc:1905] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:39.747165 17404 ts_tablet_manager.cc:1918] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:39.747323 17404 log.cc:1196] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/78e5744386cb4dbaad9d7e444e4fc6db
I20260808 08:47:39.747546 17403 ts_tablet_manager.cc:1918] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:39.747808 17403 log.cc:1196] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/78e5744386cb4dbaad9d7e444e4fc6db
I20260808 08:47:39.747855 17404 ts_tablet_manager.cc:1939] T 78e5744386cb4dbaad9d7e444e4fc6db P 7fafe733c5004a87b1646ade3317a106: Deleting consensus metadata
I20260808 08:47:39.748582 17403 ts_tablet_manager.cc:1939] T 78e5744386cb4dbaad9d7e444e4fc6db P 3537610d877948ccac01f902d24c7972: Deleting consensus metadata
I20260808 08:47:39.749830 16560 catalog_manager.cc:4841] TS 7fafe733c5004a87b1646ade3317a106 (127.8.149.65:42593): tablet 78e5744386cb4dbaad9d7e444e4fc6db (table test-table [id=2ed051051fd84579a47d6af44bfe2b2c]) successfully deleted
I20260808 08:47:39.750465 17405 tablet_replica.cc:330] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: stopping tablet replica
I20260808 08:47:39.750478 16563 catalog_manager.cc:4841] TS 3537610d877948ccac01f902d24c7972 (127.8.149.66:40379): tablet 78e5744386cb4dbaad9d7e444e4fc6db (table test-table [id=2ed051051fd84579a47d6af44bfe2b2c]) successfully deleted
I20260808 08:47:39.750866 17405 raft_consensus.cc:2229] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:39.751343 17405 raft_consensus.cc:2258] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:39.752533 17358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.739011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.8.149.65:42593)
0808 08:47:39.739166 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.739173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.750099 (+ 10926us) server_negotiation.cc:407] Connection header received
0808 08:47:39.750172 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.750175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.750272 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.750373 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.751504 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.751510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.751517 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.751536 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.751582 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.751599 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.751726 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.752056 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.752144 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:47:39.753207 16884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:39.753539 17405 ts_tablet_manager.cc:1905] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:39.759521 17405 ts_tablet_manager.cc:1918] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:39.759687 17405 log.cc:1196] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/78e5744386cb4dbaad9d7e444e4fc6db
I20260808 08:47:39.760159 17405 ts_tablet_manager.cc:1939] T 78e5744386cb4dbaad9d7e444e4fc6db P 4c7bde1809354afb91bf9a3db983c042: Deleting consensus metadata
I20260808 08:47:39.761471 16560 catalog_manager.cc:4841] TS 4c7bde1809354afb91bf9a3db983c042 (127.8.149.67:46389): tablet 78e5744386cb4dbaad9d7e444e4fc6db (table test-table [id=2ed051051fd84579a47d6af44bfe2b2c]) successfully deleted
I20260808 08:47:39.845600 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 16684
I20260808 08:47:39.877092 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 16899
I20260808 08:47:39.880261 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.878068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45236 (local address 127.8.149.66:40379)
0808 08:47:39.878245 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.878251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.878271 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:47:39.878450 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.878457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.878551 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.878658 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.879558 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.879564 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.879568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.879586 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.879638 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.879649 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.879781 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.879878 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.879947 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:47:39.880870 17108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:39.967506 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 16899
I20260808 08:47:39.995082 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 17122
I20260808 08:47:39.998059 17349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:39.995959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.8.149.67:46389)
0808 08:47:39.996172 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:39.996179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:39.996202 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:39.996285 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:39.996290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:39.996382 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:39.996491 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:39.997464 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:39.997469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:39.997473 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:39.997491 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:39.997531 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:39.997542 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:39.997663 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:39.997738 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:47:39.997795 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:47:39.998744 17325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:40.084133 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 17122
I20260808 08:47:40.111240 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 16531
I20260808 08:47:40.112581 16630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:40.216236 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 16531
2026-08-08T08:47:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2830 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 08:47:40.266992 8789 mini_oidc.cc:152] Starting JWKS server
I20260808 08:47:40.270210 8789 webserver.cc:460] Webserver started at https://127.0.0.1:45377/ using document root <none> and password file <none>
I20260808 08:47:40.270526 8789 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:47:40.271126 8789 webserver.cc:460] Webserver started at http://127.0.0.1:34021/ using document root <none> and password file <none>
2026-08-08T08:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:40Z Disabled control of system clock
I20260808 08:47:40.301795 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40301
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:40157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40301
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45377/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/testchainca.cert with env {}
W20260808 08:47:40.621915 17431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:40.622243 17431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:40.622435 17431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:40.629472 17431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:40.629604 17431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:40.629693 17431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:40.629786 17431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:40.629854 17431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:47:40.629951 17431 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:47:40.630028 17431 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45377/jwks.json
I20260808 08:47:40.639253 17431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45377/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:40.640466 17431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:40.641712 17431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:40.653211 17441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:40.653430 17444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:40.653558 17442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:40.654839 17431 server_base.cc:1034] running on GCE node
I20260808 08:47:40.655707 17431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:40.657301 17431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:40.658560 17431 hybrid_clock.cc:648] HybridClock initialized: now 1786178860658498 us; error 45 us; skew 500 ppm
I20260808 08:47:40.659080 17431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:40.664638 17431 webserver.cc:460] Webserver started at http://127.8.149.126:42237/ using document root <none> and password file <none>
I20260808 08:47:40.665323 17431 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:40.665441 17431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:40.665745 17431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:40.668605 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "59ab9875c5cb45aa90371375c08acee3"
format_stamp: "Formatted at 2026-08-08 08:47:40 on dist-test-slave-7vjv"
server_key: "7059f6baa18460c8c6c03a9dfede9c63"
server_key_iv: "abc274166dcad7f823ec98dc163ec0d6"
server_key_version: "encryptionkey@0"
I20260808 08:47:40.669377 17431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "59ab9875c5cb45aa90371375c08acee3"
format_stamp: "Formatted at 2026-08-08 08:47:40 on dist-test-slave-7vjv"
server_key: "7059f6baa18460c8c6c03a9dfede9c63"
server_key_iv: "abc274166dcad7f823ec98dc163ec0d6"
server_key_version: "encryptionkey@0"
I20260808 08:47:40.674649 17431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:40.678553 17452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:40.679839 17431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:47:40.680132 17431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "59ab9875c5cb45aa90371375c08acee3"
format_stamp: "Formatted at 2026-08-08 08:47:40 on dist-test-slave-7vjv"
server_key: "7059f6baa18460c8c6c03a9dfede9c63"
server_key_iv: "abc274166dcad7f823ec98dc163ec0d6"
server_key_version: "encryptionkey@0"
I20260808 08:47:40.680431 17431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:40.694693 17431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:40.695601 17431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:40.695976 17431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:40.716403 17431 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40301
I20260808 08:47:40.716436 17539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40301 every 8 connection(s)
I20260808 08:47:40.717806 17431 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:40.718287 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 17431
I20260808 08:47:40.718575 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:40.719450 8789 external_mini_cluster.cc:1428] Setting key 5a73dc908bae4ae2ecea10b7d4f4b649
I20260808 08:47:40.722563 17541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:40.732880 17541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3: Bootstrap starting.
I20260808 08:47:40.734193 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:40.721510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.8.149.126:40301)
0808 08:47:40.722532 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:40.722543 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:40.722592 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:47:40.724578 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:40.724599 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:40.725054 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:40.725496 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:40.726156 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.727679 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.729305 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.730042 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.730312 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:40.731686 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:40.731694 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:40.731707 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:40.732339 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:40.732437 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:40.732459 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:40.732622 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:40.732897 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 08:47:40.733193 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":346,"threads_started":1}
I20260808 08:47:40.736320 17541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:40.737457 17541 log.cc:824] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:40.737864 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:47:40.740054 17541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3: No bootstrap required, opened a new log
I20260808 08:47:40.747246 17541 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } }
I20260808 08:47:40.747586 17541 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:40.747700 17541 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59ab9875c5cb45aa90371375c08acee3, State: Initialized, Role: FOLLOWER
I20260808 08:47:40.748334 17541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } }
I20260808 08:47:40.748600 17541 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:40.748750 17541 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:40.748944 17541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:40.751786 17541 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } }
I20260808 08:47:40.752355 17541 leader_election.cc:302] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59ab9875c5cb45aa90371375c08acee3; no voters:
I20260808 08:47:40.752928 17541 leader_election.cc:288] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:40.753067 17547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:40.754319 17547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [term 1 LEADER]: Becoming Leader. State: Replica: 59ab9875c5cb45aa90371375c08acee3, State: Running, Role: LEADER
I20260808 08:47:40.754817 17547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } }
I20260808 08:47:40.754959 17541 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:40.757583 17548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59ab9875c5cb45aa90371375c08acee3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } } }
I20260808 08:47:40.757688 17550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59ab9875c5cb45aa90371375c08acee3. Latest consensus state: current_term: 1 leader_uuid: "59ab9875c5cb45aa90371375c08acee3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59ab9875c5cb45aa90371375c08acee3" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40301 } } }
I20260808 08:47:40.757982 17548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:40.758071 17550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:40.759816 17561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:40.764876 17561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:40.773106 17561 catalog_manager.cc:1347] Generated new cluster ID: ce93b9c7234b47bba30bb09b2bae1d0e
I20260808 08:47:40.773207 17561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:40.786932 17561 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:40.788177 17561 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:40.805773 17561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59ab9875c5cb45aa90371375c08acee3: Generated new TSK 0
I20260808 08:47:40.806696 17561 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:47:40.850116 17586 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 08:47:40.850339 17586 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:47:40.851454 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:40.830283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51964 (local address 127.8.149.126:40301)
0808 08:47:40.830476 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:40.830483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:40.831024 (+ 541us) server_negotiation.cc:407] Connection header received
0808 08:47:40.831354 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:40.831359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:40.831455 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:40.831597 (+ 142us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:47:40.832174 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.833182 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.834511 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.835160 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.835282 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:40.835775 (+ 493us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:47:40.850799 (+ 15024us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:47:40.851132 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51964: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 08:47:40.851575 17544 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51964: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 08:47:40.853155 17585 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:40.830199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40301 (local address 127.0.0.1:51964)
0808 08:47:40.830927 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:40.830943 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:40.831091 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:40.831623 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:40.831626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:40.831634 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:47:40.831984 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:40.831993 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.833302 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.833306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:40.834366 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:40.834378 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:40.835335 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:40.835339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:40.835468 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:40.835517 (+ 49us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:47:40.851028 (+ 15511us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:47:40.851267 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.149.126:40301: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":400,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.8.149.126:40301: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 08:47:40.854789 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 17431
I20260808 08:47:40.855850 17534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:40.947335 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 17431
2026-08-08T08:47:40Z chronyd exiting
I20260808 08:47:41.009059 8789 test_util.cc:175] -----------------------------------------------
I20260808 08:47:41.009239 8789 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178813799529-8789-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (747 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 08:47:41.014029 8789 mini_oidc.cc:152] Starting JWKS server
I20260808 08:47:41.015908 8789 webserver.cc:460] Webserver started at https://127.0.0.1:43009/ using document root <none> and password file <none>
I20260808 08:47:41.016130 8789 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:47:41.016738 8789 webserver.cc:460] Webserver started at http://127.0.0.1:45799/ using document root <none> and password file <none>
2026-08-08T08:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:41Z Disabled control of system clock
I20260808 08:47:41.046717 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35435
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:38895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:35435
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43009/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/testchainca.cert with env {}
W20260808 08:47:41.363777 17601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:41.364065 17601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:41.364234 17601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:41.371004 17601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:41.371133 17601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:41.371232 17601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:41.371366 17601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:41.371435 17601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:47:41.371536 17601 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:47:41.371608 17601 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43009/jwks.json
I20260808 08:47:41.381016 17601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:38895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:35435
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43009/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:41.382221 17601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:41.383563 17601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:41.395330 17608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:41.395380 17610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:41.395403 17613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:41.396708 17601 server_base.cc:1034] running on GCE node
I20260808 08:47:41.397423 17601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:41.398653 17601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:41.399881 17601 hybrid_clock.cc:648] HybridClock initialized: now 1786178861399818 us; error 61 us; skew 500 ppm
I20260808 08:47:41.400338 17601 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:41.402659 17601 webserver.cc:460] Webserver started at http://127.8.149.126:33239/ using document root <none> and password file <none>
I20260808 08:47:41.403322 17601 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:41.403450 17601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:41.403766 17601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:41.406522 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "cc566cd735ca471aa4bc354463567d4b"
format_stamp: "Formatted at 2026-08-08 08:47:41 on dist-test-slave-7vjv"
server_key: "f92bfa48c037e38a110ca80078e84ee3"
server_key_iv: "17efee7aa0884c80a62407c7610cfb29"
server_key_version: "encryptionkey@0"
I20260808 08:47:41.407300 17601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "cc566cd735ca471aa4bc354463567d4b"
format_stamp: "Formatted at 2026-08-08 08:47:41 on dist-test-slave-7vjv"
server_key: "f92bfa48c037e38a110ca80078e84ee3"
server_key_iv: "17efee7aa0884c80a62407c7610cfb29"
server_key_version: "encryptionkey@0"
I20260808 08:47:41.412036 17601 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 08:47:41.415373 17622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:41.416838 17601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:41.417060 17601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "cc566cd735ca471aa4bc354463567d4b"
format_stamp: "Formatted at 2026-08-08 08:47:41 on dist-test-slave-7vjv"
server_key: "f92bfa48c037e38a110ca80078e84ee3"
server_key_iv: "17efee7aa0884c80a62407c7610cfb29"
server_key_version: "encryptionkey@0"
I20260808 08:47:41.417269 17601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:41.439831 17601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:41.440591 17601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:41.440943 17601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:41.459192 17601 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:35435
I20260808 08:47:41.459223 17713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:35435 every 8 connection(s)
I20260808 08:47:41.460539 17601 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:41.464323 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 17601
I20260808 08:47:41.464552 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:41.464565 17714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:41.465476 8789 external_mini_cluster.cc:1428] Setting key d301d062ea1dc9a03b26822a52c264c9
I20260808 08:47:41.477517 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b: Bootstrap starting.
I20260808 08:47:41.479319 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:41.467493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.8.149.126:35435)
0808 08:47:41.468611 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:41.468622 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:41.468661 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:47:41.471066 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:41.471087 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:41.471514 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:41.471897 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:41.472425 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.473519 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.474863 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.475546 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.475753 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:41.477098 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:41.477123 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:41.477136 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:41.477677 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:41.477749 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:41.477772 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:41.477943 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:41.478085 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 08:47:41.478396 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":445,"threads_started":1}
I20260808 08:47:41.480901 17714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:41.482014 17714 log.cc:824] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:41.483071 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:47:41.484783 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b: No bootstrap required, opened a new log
I20260808 08:47:41.492677 17714 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } }
I20260808 08:47:41.493005 17714 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:41.493120 17714 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc566cd735ca471aa4bc354463567d4b, State: Initialized, Role: FOLLOWER
I20260808 08:47:41.493623 17714 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } }
I20260808 08:47:41.493846 17714 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:41.494002 17714 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:41.494148 17714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:41.496286 17714 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } }
I20260808 08:47:41.496765 17714 leader_election.cc:302] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc566cd735ca471aa4bc354463567d4b; no voters:
I20260808 08:47:41.497255 17714 leader_election.cc:288] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:41.497398 17722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:41.498051 17722 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [term 1 LEADER]: Becoming Leader. State: Replica: cc566cd735ca471aa4bc354463567d4b, State: Running, Role: LEADER
I20260808 08:47:41.498709 17722 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } }
I20260808 08:47:41.499428 17714 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:41.501477 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc566cd735ca471aa4bc354463567d4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } } }
I20260808 08:47:41.501794 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:41.503322 17730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:41.503242 17724 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc566cd735ca471aa4bc354463567d4b. Latest consensus state: current_term: 1 leader_uuid: "cc566cd735ca471aa4bc354463567d4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc566cd735ca471aa4bc354463567d4b" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35435 } } }
I20260808 08:47:41.503563 17724 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:41.508800 17730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:41.522747 17730 catalog_manager.cc:1347] Generated new cluster ID: 6000c801fd32472cb4c9f82da8b558dc
I20260808 08:47:41.522848 17730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:41.554000 17730 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:41.555154 17730 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:41.565852 17730 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc566cd735ca471aa4bc354463567d4b: Generated new TSK 0
I20260808 08:47:41.566601 17730 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:47:41.599364 17758 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 08:47:41.599486 17758 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:47:41.600801 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:41.580526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.8.149.126:35435)
0808 08:47:41.580718 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:41.580725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:41.581197 (+ 472us) server_negotiation.cc:407] Connection header received
0808 08:47:41.581392 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:41.581397 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:41.581495 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:41.581646 (+ 151us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:47:41.582079 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.583155 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.584598 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.585311 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.585445 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:41.585862 (+ 417us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:47:41.600046 (+ 14184us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:47:41.600452 (+ 406us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 08:47:41.600930 17718 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34428: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 08:47:41.601778 17757 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:41.580443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35435 (local address 127.0.0.1:34428)
0808 08:47:41.581099 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:41.581118 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:41.581229 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:41.581660 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:41.581664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:41.581672 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:47:41.581940 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:41.581948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.583298 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.583302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:41.584464 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:41.584475 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:41.585462 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:41.585466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:41.585592 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:41.585620 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:47:41.601161 (+ 15541us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:47:41.601398 (+ 237us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.149.126:35435: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":365,"threads_started":1}
I20260808 08:47:41.602771 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 17601
I20260808 08:47:41.604241 17707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:41.700683 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 17601
2026-08-08T08:47:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (749 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 08:47:41.762466 8789 mini_oidc.cc:152] Starting JWKS server
I20260808 08:47:41.764391 8789 webserver.cc:460] Webserver started at https://127.0.0.1:40053/ using document root <none> and password file <none>
I20260808 08:47:41.764657 8789 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:47:41.765290 8789 webserver.cc:460] Webserver started at http://127.0.0.1:33843/ using document root <none> and password file <none>
2026-08-08T08:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:41Z Disabled control of system clock
I20260808 08:47:41.798053 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39551
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:36033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39551
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40053/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:47:42.118695 17768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:42.119033 17768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:42.119194 17768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:42.126142 17768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:42.126266 17768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:42.126353 17768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:42.126461 17768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:42.126544 17768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:47:42.126631 17768 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:47:42.126717 17768 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40053/jwks.json
I20260808 08:47:42.135005 17768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:36033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40053/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:42.136185 17768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:42.137832 17768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:42.149009 17778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:42.149055 17777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:42.148993 17780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:42.149976 17768 server_base.cc:1034] running on GCE node
I20260808 08:47:42.150657 17768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:42.151937 17768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:42.153162 17768 hybrid_clock.cc:648] HybridClock initialized: now 1786178862153130 us; error 44 us; skew 500 ppm
I20260808 08:47:42.153604 17768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:42.156086 17768 webserver.cc:460] Webserver started at http://127.8.149.126:38081/ using document root <none> and password file <none>
I20260808 08:47:42.156793 17768 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:42.156924 17768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:42.157261 17768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:42.160143 17768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "7ededd9456f74b01a2b2879c7ce4ec98"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "8c9527da42ce7729d44e21557b9fafc3"
server_key_iv: "553da200afaa017cac6b92cf9aa75bb7"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.160982 17768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "7ededd9456f74b01a2b2879c7ce4ec98"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "8c9527da42ce7729d44e21557b9fafc3"
server_key_iv: "553da200afaa017cac6b92cf9aa75bb7"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.165804 17768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 08:47:42.169162 17788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:42.170393 17768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:42.170578 17768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "7ededd9456f74b01a2b2879c7ce4ec98"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "8c9527da42ce7729d44e21557b9fafc3"
server_key_iv: "553da200afaa017cac6b92cf9aa75bb7"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.170800 17768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:42.187927 17768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:42.188717 17768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:42.189050 17768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:42.207753 17768 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39551
I20260808 08:47:42.207792 17876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39551 every 8 connection(s)
I20260808 08:47:42.208978 17768 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:42.212738 17878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:42.217759 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 17768
I20260808 08:47:42.217998 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:42.218750 8789 external_mini_cluster.cc:1428] Setting key a6bf0df068e45d03fe640b7f51b585e9
I20260808 08:47:42.223731 17878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98: Bootstrap starting.
I20260808 08:47:42.226711 17878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:42.227645 17878 log.cc:824] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:42.230293 17878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98: No bootstrap required, opened a new log
I20260808 08:47:42.231521 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:42.220680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35044 (local address 127.8.149.126:39551)
0808 08:47:42.221618 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:42.221628 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:42.221666 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:47:42.223243 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:42.223261 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:42.223637 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:42.223953 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:42.224734 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.226026 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.227326 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.228015 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.228258 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:42.229364 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:42.229371 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:42.229383 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:42.229864 (+ 481us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:42.229935 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:42.229955 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:42.230089 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:42.230301 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 08:47:42.230620 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":336,"threads_started":1}
I20260808 08:47:42.235399 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:47:42.239645 17878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } }
I20260808 08:47:42.239933 17878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:42.240002 17878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ededd9456f74b01a2b2879c7ce4ec98, State: Initialized, Role: FOLLOWER
I20260808 08:47:42.240576 17878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } }
I20260808 08:47:42.240779 17878 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:42.240873 17878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:42.240984 17878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:42.242874 17878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } }
I20260808 08:47:42.243342 17878 leader_election.cc:302] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ededd9456f74b01a2b2879c7ce4ec98; no voters:
I20260808 08:47:42.243793 17878 leader_election.cc:288] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:42.243957 17886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:42.244670 17886 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [term 1 LEADER]: Becoming Leader. State: Replica: 7ededd9456f74b01a2b2879c7ce4ec98, State: Running, Role: LEADER
I20260808 08:47:42.245177 17886 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } }
I20260808 08:47:42.245821 17878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:42.247948 17889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ededd9456f74b01a2b2879c7ce4ec98. Latest consensus state: current_term: 1 leader_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } } }
I20260808 08:47:42.248333 17889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:42.248711 17887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ededd9456f74b01a2b2879c7ce4ec98" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39551 } } }
I20260808 08:47:42.249142 17887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:42.250293 17896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:42.255709 17896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:42.263319 17896 catalog_manager.cc:1347] Generated new cluster ID: 844df074429440cfad7cece67ead8c2c
I20260808 08:47:42.263425 17896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:42.273615 17896 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:42.275357 17896 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:42.282975 17896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ededd9456f74b01a2b2879c7ce4ec98: Generated new TSK 0
I20260808 08:47:42.283680 17896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:47:42.313835 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:42.305641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35046 (local address 127.8.149.126:39551)
0808 08:47:42.305828 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:42.305834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:42.306250 (+ 416us) server_negotiation.cc:407] Connection header received
0808 08:47:42.306439 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:42.306445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:42.306533 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:42.306690 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:47:42.307101 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.308219 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.309615 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.310354 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.310494 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:42.310952 (+ 458us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:47:42.313171 (+ 2219us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:47:42.313466 (+ 295us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35046: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 08:47:42.313959 17882 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35046: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 08:47:42.315568 17922 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:42.305534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39551 (local address 127.0.0.1:35046)
0808 08:47:42.306150 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:42.306165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:42.306275 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:42.306700 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:42.306703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:42.306711 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:47:42.306945 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:42.306952 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.308352 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.308355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:42.309473 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:42.309483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.310543 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.310547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:42.310661 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:42.310706 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:47:42.313358 (+ 2652us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:47:42.315177 (+ 1819us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.149.126:39551: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40053/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":1557,"thread_start_us":330,"threads_started":1}
I20260808 08:47:42.317236 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 17768
I20260808 08:47:42.318239 17870 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 08:47:42.329365 17923 webserver.cc:533] Webserver: sslize failed:
E20260808 08:47:42.329493 17923 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:47:42.413107 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 17768
2026-08-08T08:47:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (710 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T08:47:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:42Z Disabled control of system clock
I20260808 08:47:42.506846 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:42993
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:38305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:42993
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/testchainca.cert with env {}
W20260808 08:47:42.830507 17931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:42.830786 17931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:42.830924 17931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:42.838124 17931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:42.838220 17931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:42.838263 17931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:42.838359 17931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:42.838451 17931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:47:42.838574 17931 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:47:42.838655 17931 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 08:47:42.848125 17931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:38305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:42993
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:42993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:42.849278 17931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:42.850535 17931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:42.863060 17946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:42.863126 17943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:42.863122 17948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:42.863907 17931 server_base.cc:1034] running on GCE node
I20260808 08:47:42.864768 17931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:42.866101 17931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:42.867368 17931 hybrid_clock.cc:648] HybridClock initialized: now 1786178862867307 us; error 28 us; skew 500 ppm
I20260808 08:47:42.867769 17931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:47:42.870074 17931 webserver.cc:460] Webserver started at http://127.8.149.126:34009/ using document root <none> and password file <none>
I20260808 08:47:42.870806 17931 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:42.870954 17931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:42.871287 17931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:42.874511 17931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "9a0f68c7b0524aac9a9aef1124e71f59"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "c1f87bd400ee98815e3f62bb45b8bbab"
server_key_iv: "45e647ff8b62445141c0e5a4150fbe5b"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.875315 17931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "9a0f68c7b0524aac9a9aef1124e71f59"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "c1f87bd400ee98815e3f62bb45b8bbab"
server_key_iv: "45e647ff8b62445141c0e5a4150fbe5b"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.880266 17931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:47:42.883572 17956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:42.884902 17931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:42.885097 17931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "9a0f68c7b0524aac9a9aef1124e71f59"
format_stamp: "Formatted at 2026-08-08 08:47:42 on dist-test-slave-7vjv"
server_key: "c1f87bd400ee98815e3f62bb45b8bbab"
server_key_iv: "45e647ff8b62445141c0e5a4150fbe5b"
server_key_version: "encryptionkey@0"
I20260808 08:47:42.885311 17931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:42.900593 17931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:42.901309 17931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:42.901593 17931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:42.920315 17931 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:42993
I20260808 08:47:42.920339 18040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:42993 every 8 connection(s)
I20260808 08:47:42.921589 17931 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:42.925251 18041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:42.926863 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 17931
I20260808 08:47:42.927081 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:42.927755 8789 external_mini_cluster.cc:1428] Setting key ebd251fe2ac4b2ab741548916f929181
I20260808 08:47:42.938423 18041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59: Bootstrap starting.
I20260808 08:47:42.942219 18041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:42.943243 18047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:42.929620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46794 (local address 127.8.149.126:42993)
0808 08:47:42.930681 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:42.930697 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:42.930767 (+ 70us) server_negotiation.cc:407] Connection header received
0808 08:47:42.933203 (+ 2436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:42.933229 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:42.933731 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:42.934185 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:42.934715 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.936768 (+ 2053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.938034 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:42.939106 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:42.939288 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:42.940442 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:42.940452 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:42.940473 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:47:42.941185 (+ 712us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:42.941308 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:47:42.941336 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:42.941456 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:42.941644 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 08:47:42.941951 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":351,"threads_started":1}
I20260808 08:47:42.943590 18041 log.cc:824] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:42.946547 18041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59: No bootstrap required, opened a new log
I20260808 08:47:42.946916 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:47:42.953794 18041 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } }
I20260808 08:47:42.954136 18041 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:42.954254 18041 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a0f68c7b0524aac9a9aef1124e71f59, State: Initialized, Role: FOLLOWER
I20260808 08:47:42.954842 18041 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } }
I20260808 08:47:42.955075 18041 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:42.955224 18041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:42.955416 18041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:42.957624 18041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } }
I20260808 08:47:42.958134 18041 leader_election.cc:302] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a0f68c7b0524aac9a9aef1124e71f59; no voters:
I20260808 08:47:42.958683 18041 leader_election.cc:288] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:42.958837 18049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:42.959561 18049 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [term 1 LEADER]: Becoming Leader. State: Replica: 9a0f68c7b0524aac9a9aef1124e71f59, State: Running, Role: LEADER
I20260808 08:47:42.960135 18049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } }
I20260808 08:47:42.960732 18041 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:42.962865 18053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a0f68c7b0524aac9a9aef1124e71f59. Latest consensus state: current_term: 1 leader_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } } }
I20260808 08:47:42.963217 18053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:42.963785 18052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a0f68c7b0524aac9a9aef1124e71f59" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 42993 } } }
I20260808 08:47:42.964241 18052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:42.967342 18061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:42.972594 18061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:42.980913 18061 catalog_manager.cc:1347] Generated new cluster ID: 39d49d15c2f2483381d107418d69715a
I20260808 08:47:42.981027 18061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:43.007201 18061 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:43.009064 18061 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:43.022168 18061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a0f68c7b0524aac9a9aef1124e71f59: Generated new TSK 0
I20260808 08:47:43.022940 18061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:47:43.490459 18047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:43.034968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46804 (local address 127.8.149.126:42993)
0808 08:47:43.035186 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:43.035194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:43.035543 (+ 349us) server_negotiation.cc:407] Connection header received
0808 08:47:43.035760 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:43.035766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:43.035855 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:43.036018 (+ 163us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:47:43.036516 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:43.037588 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:43.038932 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:43.039648 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:43.039801 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:43.040243 (+ 442us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:47:43.489902 (+449659us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:47:43.490228 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46804: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":94}
W20260808 08:47:43.490561 18047 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46804: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 08:47:43.490820 18088 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:43.034837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:42993 (local address 127.0.0.1:46804)
0808 08:47:43.035436 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:43.035451 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:43.035568 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:43.036025 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:43.036028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:43.036036 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:47:43.036345 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:43.036353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:43.037720 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:43.037723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:43.038782 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:43.038793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:43.039824 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:43.039828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:43.039946 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:43.039975 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:47:43.490167 (+450192us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:47:43.490427 (+ 260us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.8.149.126:42993: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":337,"threads_started":1}
I20260808 08:47:43.491986 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 17931
I20260808 08:47:43.493160 18033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:43.593065 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 17931
2026-08-08T08:47:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1167 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (407 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (414 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:44 dist-test-slave-7vjv krb5kdc[18108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:44 dist-test-slave-7vjv krb5kdc[18108](info): set up 2 sockets
Aug 08 08:47:44 dist-test-slave-7vjv krb5kdc[18108](info): commencing operation
krb5kdc: starting...
W20260808 08:47:45.690527 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:45 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:47:45.909636 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35641
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:35641
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:46.235582 18129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:46.236177 18129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:46.236316 18129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:46.243510 18129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:46.243602 18129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:46.243644 18129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:46.243698 18129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:46.243739 18129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:46.253424 18129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:35641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:46.254643 18129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:46.255903 18129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:46.267804 18138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:46.268064 18140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:46.267834 18142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:46.268772 18129 server_base.cc:1034] running on GCE node
I20260808 08:47:46.269577 18129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:46.270903 18129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:46.272181 18129 hybrid_clock.cc:648] HybridClock initialized: now 1786178866272131 us; error 46 us; skew 500 ppm
I20260808 08:47:46.272549 18129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:46 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178866, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:46.278239 18129 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:47:46.279794 18129 webserver.cc:460] Webserver started at http://127.8.149.126:36799/ using document root <none> and password file <none>
I20260808 08:47:46.280521 18129 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:46.280675 18129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:46.281020 18129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:46.284521 18129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "187516445d4c45fbaee287677474cad4"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "33f6689d11f82b6a174dab0f8a870347"
server_key_iv: "1dfd26e59f86114006042b3cf63197a4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.285377 18129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "187516445d4c45fbaee287677474cad4"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "33f6689d11f82b6a174dab0f8a870347"
server_key_iv: "1dfd26e59f86114006042b3cf63197a4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.290966 18129 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:47:46.294682 18151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:46.296007 18129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:47:46.296223 18129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "187516445d4c45fbaee287677474cad4"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "33f6689d11f82b6a174dab0f8a870347"
server_key_iv: "1dfd26e59f86114006042b3cf63197a4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.296406 18129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:46.310228 18129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:46.314631 18129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:46.314901 18129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:46.336062 18129 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:35641
I20260808 08:47:46.336124 18228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:35641 every 8 connection(s)
I20260808 08:47:46.338286 18129 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:46.338688 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 18129
I20260808 08:47:46.338919 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:46.339991 8789 external_mini_cluster.cc:1428] Setting key 19dc42b73bd201403d678125a0ad296d
I20260808 08:47:46.344167 18231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:46 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:46.357206 18231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4: Bootstrap starting.
I20260808 08:47:46.361599 18231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:46.362881 18231 log.cc:824] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:46.366358 18231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4: No bootstrap required, opened a new log
I20260808 08:47:46.367014 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:46.342513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.8.149.126:35641)
0808 08:47:46.343472 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:46.343488 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:46.343586 (+ 98us) server_negotiation.cc:407] Connection header received
0808 08:47:46.346198 (+ 2612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:46.346225 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:46.346741 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:46.347154 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:46.348992 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.351048 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.352520 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.353550 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.353733 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:46.358027 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:46.358038 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:46.358055 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:46.358108 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:46.362340 (+ 4232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:46.363095 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:46.363104 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:46.363111 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:46.363330 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:46.363851 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:46.363856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:46.363859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:46.364540 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:46.364836 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:46.365243 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 08:47:46.365674 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":469,"threads_started":1}
I20260808 08:47:46.374948 18231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } }
I20260808 08:47:46.375289 18231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:46.375370 18231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187516445d4c45fbaee287677474cad4, State: Initialized, Role: FOLLOWER
I20260808 08:47:46.375845 18231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } }
I20260808 08:47:46.376066 18231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:46.376282 18231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:46.376415 18231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:46.378417 18231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } }
I20260808 08:47:46.379026 18231 leader_election.cc:302] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 187516445d4c45fbaee287677474cad4; no voters:
I20260808 08:47:46.379750 18231 leader_election.cc:288] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:46.379858 18238 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:46.380718 18238 raft_consensus.cc:686] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [term 1 LEADER]: Becoming Leader. State: Replica: 187516445d4c45fbaee287677474cad4, State: Running, Role: LEADER
I20260808 08:47:46.381314 18238 consensus_queue.cc:237] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } }
I20260808 08:47:46.382025 18231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:46.384016 18239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "187516445d4c45fbaee287677474cad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } } }
I20260808 08:47:46.384517 18239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:46.384385 18240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 187516445d4c45fbaee287677474cad4. Latest consensus state: current_term: 1 leader_uuid: "187516445d4c45fbaee287677474cad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187516445d4c45fbaee287677474cad4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35641 } } }
I20260808 08:47:46.384684 18240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:46.386556 18245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:46.392077 18245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:46.402915 18245 catalog_manager.cc:1347] Generated new cluster ID: 620a0fd3950145819f97b635b8b599b2
I20260808 08:47:46.403023 18245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:46.427802 18245 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:46.429044 18245 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:46.438171 18245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 187516445d4c45fbaee287677474cad4: Generated new TSK 0
I20260808 08:47:46.438944 18245 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:47:46.500077 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:46.831254 18271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:46.831518 18271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:46.831660 18271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:46.838707 18271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:46.838800 18271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:46.839020 18271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:46.847831 18271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:46.848984 18271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:46.850207 18271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:46.863122 18280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:46.863135 18281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:46.863682 18283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:46.864410 18271 server_base.cc:1034] running on GCE node
I20260808 08:47:46.865091 18271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:46.865976 18271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:46.867224 18271 hybrid_clock.cc:648] HybridClock initialized: now 1786178866867167 us; error 40 us; skew 500 ppm
I20260808 08:47:46.867558 18271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:46 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178866, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:46.870841 18271 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:47:46.872319 18271 webserver.cc:460] Webserver started at http://127.8.149.65:46095/ using document root <none> and password file <none>
I20260808 08:47:46.873008 18271 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:46.873169 18271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:46.873503 18271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:46.876401 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "31af888fb7df4499a4a40813a3728ad3"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "150bebd24c5b541acf5be33a040ba744"
server_key_iv: "45eeed574b6655946fb5348fabceadc4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.877218 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "31af888fb7df4499a4a40813a3728ad3"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "150bebd24c5b541acf5be33a040ba744"
server_key_iv: "45eeed574b6655946fb5348fabceadc4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.882553 18271 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:46.886224 18297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:46.887562 18271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:46.887744 18271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "31af888fb7df4499a4a40813a3728ad3"
format_stamp: "Formatted at 2026-08-08 08:47:46 on dist-test-slave-7vjv"
server_key: "150bebd24c5b541acf5be33a040ba744"
server_key_iv: "45eeed574b6655946fb5348fabceadc4"
server_key_version: "encryptionkey@0"
I20260808 08:47:46.887964 18271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:46.916416 18271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:46.920751 18271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:46.921088 18271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:46.922070 18271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:46.923437 18271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:46.923549 18271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:46.923707 18271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:46.923795 18271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:46.959131 18271 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:38485
I20260808 08:47:46.959175 18471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:38485 every 8 connection(s)
I20260808 08:47:46.960579 18271 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:46.963819 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 18271
I20260808 08:47:46.964015 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:46.964895 8789 external_mini_cluster.cc:1428] Setting key 3f21c1f866717e30e571c9102e218d6e
Aug 08 08:47:46 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178866, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:46.982882 18475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:46.963245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:36305 (local address 127.8.149.126:35641)
0808 08:47:46.963713 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:46.963720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:46.965068 (+ 1348us) server_negotiation.cc:407] Connection header received
0808 08:47:46.967189 (+ 2121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:46.967192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:46.967248 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:46.967328 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:46.969362 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.970125 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.972472 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.972865 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.972988 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:46.977119 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:46.977124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:46.977126 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:46.977156 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:46.979596 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:46.980410 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:46.980421 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:46.980423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:46.980538 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:46.981022 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:46.981026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:46.981028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:46.981371 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:46.981540 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:46.982241 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 08:47:46.982475 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":229,"threads_started":1}
I20260808 08:47:46.983819 18476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:46.963940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35641 (local address 127.8.149.65:36305)
0808 08:47:46.964908 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:46.964961 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:46.966886 (+ 1925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:46.967579 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:46.967589 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:46.968340 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:46.969170 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:46.969197 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.970295 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.970303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:46.972308 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:46.972325 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:46.973096 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:46.973105 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:46.973443 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:46.974210 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:46.974242 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:46.976901 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:46.979752 (+ 2851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:46.979760 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:46.979775 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:46.980290 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:46.980662 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:46.980667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:46.980670 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:46.980857 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:46.981515 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:46.981523 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:46.981847 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 08:47:46.982121 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 08:47:46.982655 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":344,"threads_started":1}
I20260808 08:47:46.985555 18472 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35641
I20260808 08:47:46.985891 18472 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:46.986644 18472 heartbeater.cc:511] Master 127.8.149.126:35641 requested a full tablet report, sending...
I20260808 08:47:46.989210 18179 ts_manager.cc:194] Registered new tserver with Master: 31af888fb7df4499a4a40813a3728ad3 (127.8.149.65:38485)
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
I20260808 08:47:46.990926 18179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:36305
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:47:47.017474 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:47.339310 18482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:47.339627 18482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:47.339812 18482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:47.346587 18482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:47.346722 18482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:47.346920 18482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:47.358021 18482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:47.359231 18482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:47.360587 18482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:47.372937 18488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:47.373059 18489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:47.373098 18493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:47.373976 18482 server_base.cc:1034] running on GCE node
I20260808 08:47:47.374580 18482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:47.375432 18482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:47.376662 18482 hybrid_clock.cc:648] HybridClock initialized: now 1786178867376587 us; error 68 us; skew 500 ppm
I20260808 08:47:47.376987 18482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:47 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178867, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:47.380021 18482 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:47:47.381428 18482 webserver.cc:460] Webserver started at http://127.8.149.66:46221/ using document root <none> and password file <none>
I20260808 08:47:47.382069 18482 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:47.382213 18482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:47.382553 18482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:47.385304 18482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "950fa100d83143619e086955567eb2e3"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "eca3023ee73d457a5d709830695911aa"
server_key_iv: "9e3504513a44e36ac3723005a84e679a"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.386124 18482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "950fa100d83143619e086955567eb2e3"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "eca3023ee73d457a5d709830695911aa"
server_key_iv: "9e3504513a44e36ac3723005a84e679a"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.391177 18482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 08:47:47.394778 18502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.396250 18482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:47:47.396417 18482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "950fa100d83143619e086955567eb2e3"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "eca3023ee73d457a5d709830695911aa"
server_key_iv: "9e3504513a44e36ac3723005a84e679a"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.396615 18482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:47.421976 18482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:47.426132 18482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:47.426409 18482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:47.427285 18482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:47.428632 18482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:47.428738 18482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.428907 18482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:47.428982 18482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.463568 18482 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:43839
I20260808 08:47:47.463660 18700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:43839 every 8 connection(s)
I20260808 08:47:47.465090 18482 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:47.467116 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 18482
I20260808 08:47:47.467326 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:47.467957 8789 external_mini_cluster.cc:1428] Setting key c6892814cd176f50775ab21a43733b80
Aug 08 08:47:47 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178867, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:47.487237 18475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:47.468165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:40275 (local address 127.8.149.126:35641)
0808 08:47:47.468391 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:47.468398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:47.469819 (+ 1421us) server_negotiation.cc:407] Connection header received
0808 08:47:47.471619 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:47.471627 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:47.471721 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:47.471838 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:47.473382 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.474518 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.476008 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.476757 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.476912 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:47.480429 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:47.480438 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:47.480444 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:47.480484 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:47.484257 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:47.484939 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:47.484944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:47.484949 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:47.485089 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:47.485560 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:47.485569 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:47.485571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:47.485829 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:47.485995 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:47.486660 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 08:47:47.486892 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:47:47.488235 18703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:47.468747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35641 (local address 127.8.149.66:40275)
0808 08:47:47.469662 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:47.469708 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:47.471346 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:47.472023 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:47.472030 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:47.472602 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:47.473209 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:47.473228 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.474668 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.474671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:47.475857 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:47.475868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.476979 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.476984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:47.477166 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:47.477838 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:47.477859 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:47.480209 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:47.484387 (+ 4178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:47.484394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:47.484404 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:47.484798 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:47.485201 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:47.485206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:47.485209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:47.485432 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:47.485981 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:47.485988 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:47.486287 (+ 299us) client_negotiation.cc:769] Sending connection context
0808 08:47:47.486540 (+ 253us) client_negotiation.cc:240] Negotiation successful
0808 08:47:47.487053 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":415,"threads_started":1}
I20260808 08:47:47.489713 18701 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35641
I20260808 08:47:47.490063 18701 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:47.490893 18701 heartbeater.cc:511] Master 127.8.149.126:35641 requested a full tablet report, sending...
I20260808 08:47:47.492594 18179 ts_manager.cc:194] Registered new tserver with Master: 950fa100d83143619e086955567eb2e3 (127.8.149.66:43839)
I20260808 08:47:47.493530 18179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:40275
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:47:47.521311 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:47.830678 18707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:47.830982 18707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:47.831138 18707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:47.838482 18707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:47.838613 18707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:47.838784 18707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:47.847335 18707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:35641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:47.848559 18707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:47.849735 18707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:47.861873 18712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:47.861985 18713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:47.862248 18716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:47.863427 18707 server_base.cc:1034] running on GCE node
I20260808 08:47:47.864156 18707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:47.865000 18707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:47.866214 18707 hybrid_clock.cc:648] HybridClock initialized: now 1786178867866155 us; error 52 us; skew 500 ppm
I20260808 08:47:47.866519 18707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:47 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178867, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:47.869663 18707 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:47:47.871107 18707 webserver.cc:460] Webserver started at http://127.8.149.67:33605/ using document root <none> and password file <none>
I20260808 08:47:47.871789 18707 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:47.871944 18707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:47.872308 18707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:47.874953 18707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "b667fcf079ef4f5b838f1b0f5110dd07"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "89bdeb23c3c93209cbdfec961b3338ea"
server_key_iv: "e4d3c39f463ada0b893312a52683e980"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.875653 18707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "b667fcf079ef4f5b838f1b0f5110dd07"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "89bdeb23c3c93209cbdfec961b3338ea"
server_key_iv: "e4d3c39f463ada0b893312a52683e980"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.880735 18707 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:47:47.884011 18727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.885255 18707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:47:47.885416 18707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "b667fcf079ef4f5b838f1b0f5110dd07"
format_stamp: "Formatted at 2026-08-08 08:47:47 on dist-test-slave-7vjv"
server_key: "89bdeb23c3c93209cbdfec961b3338ea"
server_key_iv: "e4d3c39f463ada0b893312a52683e980"
server_key_version: "encryptionkey@0"
I20260808 08:47:47.885596 18707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:47.897339 18707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:47.901441 18707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:47.901700 18707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:47.902529 18707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:47.903718 18707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:47.903820 18707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.903964 18707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:47.904035 18707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:47.937400 18707 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44487
I20260808 08:47:47.937474 18906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44487 every 8 connection(s)
I20260808 08:47:47.938521 18707 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:47.939527 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 18707
I20260808 08:47:47.939728 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:47.940325 8789 external_mini_cluster.cc:1428] Setting key a397c109e9e31823e1f5c6bc311912c0
Aug 08 08:47:47 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178867, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:47:47.964399 18475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:47.941357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:41649 (local address 127.8.149.126:35641)
0808 08:47:47.941543 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:47.941547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:47.942928 (+ 1381us) server_negotiation.cc:407] Connection header received
0808 08:47:47.944923 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:47.944927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:47.944990 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:47.945065 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:47.947071 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.948345 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.950931 (+ 2586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.951725 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.951919 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:47.957841 (+ 5922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:47.957847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:47.957864 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:47.957911 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:47.961185 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:47.961886 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:47.961901 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:47.961904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:47.962074 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:47.962593 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:47.962599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:47.962603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:47.962972 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:47.963141 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:47.963745 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 08:47:47.963972 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:47:47.965060 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:47.941852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:35641 (local address 127.8.149.67:41649)
0808 08:47:47.942752 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:47.942801 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:47.944684 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:47.945264 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:47.945272 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:47.946029 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:47.946850 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:47.946873 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.948560 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.948565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:47.950726 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:47.950743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:47.951992 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:47.952003 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:47.952368 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:47.955163 (+ 2795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:47.955184 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:47.957635 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:47.961305 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:47.961314 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:47.961327 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:47.961756 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:47.962220 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:47.962227 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:47.962232 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:47.962453 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:47.963116 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:47.963121 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:47.963386 (+ 265us) client_negotiation.cc:769] Sending connection context
0808 08:47:47.963597 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 08:47:47.963995 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":327,"threads_started":1}
I20260808 08:47:47.966352 18907 heartbeater.cc:347] Connected to a master server at 127.8.149.126:35641
I20260808 08:47:47.966701 18907 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:47.967720 18907 heartbeater.cc:511] Master 127.8.149.126:35641 requested a full tablet report, sending...
I20260808 08:47:47.969655 18179 ts_manager.cc:194] Registered new tserver with Master: b667fcf079ef4f5b838f1b0f5110dd07 (127.8.149.67:44487)
I20260808 08:47:47.970827 18179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:41649
I20260808 08:47:47.973762 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:47:47.994330 18472 heartbeater.cc:503] Master 127.8.149.126:35641 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/test-admin.keytab.
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.009538 8789 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 08:47:48.014817 18918 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:48.012304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44284 (local address 127.8.149.65:38485)
0808 08:47:48.012910 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.012919 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.012944 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:47:48.013001 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.013007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.013205 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.013320 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.014393 (+ 1073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44284: BlockingRecv error: recv got EOF from 127.0.0.1:44284 (error 108)
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":329,"threads_started":1}
W20260808 08:47:48.014830 8789 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.016839 8789 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.018206 8789 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:48.033427 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.019809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.8.149.65:38485)
0808 08:47:48.020041 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.020047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.020357 (+ 310us) server_negotiation.cc:407] Connection header received
0808 08:47:48.020564 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.020568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.020626 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.020725 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.021694 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.022600 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.023872 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.024477 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.024617 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.028007 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.028017 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.028031 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.028059 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.030705 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.031291 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.031305 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.031308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.031420 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.031788 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.031793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.031797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.032230 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.032520 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.032852 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.033168 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
W20260808 08:47:48.038944 18918 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:48.037178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44306 (local address 127.8.149.65:38485)
0808 08:47:48.037412 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.037417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.037652 (+ 235us) server_negotiation.cc:407] Connection header received
0808 08:47:48.037817 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.037826 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.037899 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.037993 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.038698 (+ 705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44306: BlockingRecv error: recv got EOF from 127.0.0.1:44306 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:47:48.039134 8789 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.040580 8789 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.041850 8789 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:48.054515 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.042882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.8.149.65:38485)
0808 08:47:48.043071 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.043078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.043375 (+ 297us) server_negotiation.cc:407] Connection header received
0808 08:47:48.043539 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.043548 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.043592 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.043680 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.044668 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.045331 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.046414 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.046783 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.046911 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.049994 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.049998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.050001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.050038 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.052241 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.052851 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.052856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.052859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.052982 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.053332 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.053337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.053340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.053604 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.053859 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.054115 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.054287 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 08:47:48.058490 18918 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:47:48.056903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44318 (local address 127.8.149.65:38485)
0808 08:47:48.057071 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.057078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.057336 (+ 258us) server_negotiation.cc:407] Connection header received
0808 08:47:48.057493 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.057497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.057580 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.057673 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.058310 (+ 637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44318: BlockingRecv error: recv got EOF from 127.0.0.1:44318 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 08:47:48.058770 8789 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178813799529-8789-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.060338 8789 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:48.061617 8789 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:47:48.075449 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.062915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44332 (local address 127.8.149.65:38485)
0808 08:47:48.063099 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.063107 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.063269 (+ 162us) server_negotiation.cc:407] Connection header received
0808 08:47:48.063419 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.063422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.063468 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.063533 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.064570 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.065161 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.066345 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.066775 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.066901 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.070444 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.070448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.070451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.070479 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.073148 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.073849 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.073853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.073855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.074035 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.074452 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.074455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.074457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.074688 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.074941 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.075076 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.075218 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:47:48.076874 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 18271
I20260808 08:47:48.087199 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.077449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.8.149.65:38485)
0808 08:47:48.077575 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.077579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.077932 (+ 353us) server_negotiation.cc:407] Connection header received
0808 08:47:48.077998 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.078001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.078045 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.078113 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.078907 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.079528 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.080688 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.081031 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.081116 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.082855 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.082861 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.082866 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.082905 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.085153 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.085711 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.085715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.085717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.085847 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.086168 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.086171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.086173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.086393 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.086572 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.086790 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.086960 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:47:48.087790 18466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:48.167166 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 18271
I20260808 08:47:48.193812 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 18482
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:47:48.209148 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.194749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36780 (local address 127.8.149.66:43839)
0808 08:47:48.195360 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.195366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.195390 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:47:48.195449 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.195455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.195662 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.195782 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.196766 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.197747 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.199013 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.199654 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.199753 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.203744 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.203753 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.203766 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.203795 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.206596 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.207195 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.207201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.207203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.207320 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.207663 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.207666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.207668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.207960 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.208333 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.208589 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.208849 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":333,"threads_started":1}
I20260808 08:47:48.210261 18694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:48.290282 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 18482
I20260808 08:47:48.316794 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 18707
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:47:48.333299 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:48.317785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48984 (local address 127.8.149.67:44487)
0808 08:47:48.318410 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:48.318417 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:48.318447 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:47:48.318506 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:48.318512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:48.318717 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:48.318905 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:48.320053 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.321135 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.322407 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:48.322974 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:48.323116 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:48.327284 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:48.327296 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:48.327310 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:48.327346 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:48.330401 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.331139 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.331147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.331149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.331273 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:48.331661 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:48.331667 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:48.331670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:48.332016 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:48.332411 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:48.332728 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 08:47:48.333022 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":317,"threads_started":1}
I20260808 08:47:48.334568 18901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:48.423539 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 18707
I20260808 08:47:48.445029 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 18129
I20260808 08:47:48.446422 18221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:48.548285 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 18129
2026-08-08T08:47:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4138 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18950](info): set up 2 sockets
Aug 08 08:47:48 dist-test-slave-7vjv krb5kdc[18950](info): commencing operation
krb5kdc: starting...
W20260808 08:47:49.829084 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:47:49 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:47:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:47:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab.
Entry for principal oryx/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab.
I20260808 08:47:50.049829 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41123
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab
--principal=oryx/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:50.381330 18973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:50.381611 18973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:50.381713 18973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:50.388973 18973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:50.389071 18973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:50.389134 18973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:50.389197 18973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:50.389266 18973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:50.398870 18973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab
--principal=oryx/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:50.400144 18973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:50.401423 18973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:50.414340 18982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:50.414372 18987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:50.414858 18983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:50.414932 18973 server_base.cc:1034] running on GCE node
I20260808 08:47:50.415827 18973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:50.417302 18973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:50.418574 18973 hybrid_clock.cc:648] HybridClock initialized: now 1786178870418506 us; error 54 us; skew 500 ppm
I20260808 08:47:50.418982 18973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:50 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178870, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:50.422165 18973 init.cc:377] Logged in from keytab as oryx/127.8.149.126@KRBTEST.COM (short username oryx)
I20260808 08:47:50.423619 18973 webserver.cc:460] Webserver started at http://127.8.149.126:38329/ using document root <none> and password file <none>
I20260808 08:47:50.424369 18973 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:50.424521 18973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:50.424849 18973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:50.427845 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "9959d16b17444ea993f89612790369c1"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "0408b10964677558a83cc142a1415243"
server_key_iv: "d8ae4ca01593ace9abb810d1f898f15f"
server_key_version: "encryptionkey@0"
I20260808 08:47:50.428707 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "9959d16b17444ea993f89612790369c1"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "0408b10964677558a83cc142a1415243"
server_key_iv: "d8ae4ca01593ace9abb810d1f898f15f"
server_key_version: "encryptionkey@0"
I20260808 08:47:50.433887 18973 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:50.437541 18999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:50.438901 18973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:47:50.439049 18973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "9959d16b17444ea993f89612790369c1"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "0408b10964677558a83cc142a1415243"
server_key_iv: "d8ae4ca01593ace9abb810d1f898f15f"
server_key_version: "encryptionkey@0"
I20260808 08:47:50.439204 18973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:50.453500 18973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:50.457635 18973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:50.457854 18973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:50.475937 18973 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:41123
I20260808 08:47:50.476013 19082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:41123 every 8 connection(s)
I20260808 08:47:50.477360 18973 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:47:50.479126 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 18973
I20260808 08:47:50.479369 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:47:50.480316 8789 external_mini_cluster.cc:1428] Setting key 2e229b234e4d5f728216eb688b6b7869
I20260808 08:47:50.482287 19083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:47:50 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:50.496519 19083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Bootstrap starting.
I20260808 08:47:50.499652 19083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:50.500988 19083 log.cc:824] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:50.504047 19086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:50.482504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59022 (local address 127.8.149.126:41123)
0808 08:47:50.483262 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:50.483291 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:50.483336 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:47:50.484983 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:50.485001 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:50.485372 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:50.485686 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:50.487694 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:50.489226 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:50.491079 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:50.491735 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:50.491873 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:50.496561 (+ 4688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:50.496568 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:50.496578 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:50.496645 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:50.499457 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:50.500502 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:50.500509 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:50.500515 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:50.500702 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:50.501103 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:50.501108 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:50.501111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:50.501873 (+ 762us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:50.502224 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:50.502509 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 08:47:50.502905 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":493,"threads_started":1}
I20260808 08:47:50.504319 19083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: No bootstrap required, opened a new log
I20260808 08:47:50.511874 19083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } }
I20260808 08:47:50.512271 19083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:50.512375 19083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9959d16b17444ea993f89612790369c1, State: Initialized, Role: FOLLOWER
I20260808 08:47:50.512944 19083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } }
I20260808 08:47:50.513136 19083 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:47:50.513224 19083 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:47:50.513340 19083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:50.515131 19083 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } }
I20260808 08:47:50.515509 19083 leader_election.cc:302] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9959d16b17444ea993f89612790369c1; no voters:
I20260808 08:47:50.516247 19083 leader_election.cc:288] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:47:50.516358 19089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:50.517251 19089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9959d16b17444ea993f89612790369c1, State: Running, Role: LEADER
I20260808 08:47:50.517848 19089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } }
I20260808 08:47:50.518426 19083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:50.521113 19091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9959d16b17444ea993f89612790369c1. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } }
I20260808 08:47:50.521469 19091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:50.521996 19090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } }
I20260808 08:47:50.522310 19090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:50.523483 19100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:50.528667 19100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:50.537442 19100 catalog_manager.cc:1347] Generated new cluster ID: d4e260686e7a45dc9036d19dee59779e
I20260808 08:47:50.537569 19100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:50.554584 19100 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:47:50.555709 19100 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:50.563737 19100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Generated new TSK 0
I20260808 08:47:50.564464 19100 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
I20260808 08:47:50.631448 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:50.951491 19120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:50.951741 19120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:50.951830 19120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:50.958843 19120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:50.958935 19120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:50.959045 19120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:50.968333 19120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:50.969406 19120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:50.970692 19120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:50.983390 19131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:50.983484 19138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:50.983533 19134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:50.984820 19120 server_base.cc:1034] running on GCE node
I20260808 08:47:50.985422 19120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:50.986307 19120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:50.987521 19120 hybrid_clock.cc:648] HybridClock initialized: now 1786178870987494 us; error 55 us; skew 500 ppm
I20260808 08:47:50.987829 19120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:50 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178870, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:50.991138 19120 init.cc:377] Logged in from keytab as oryx/127.8.149.65@KRBTEST.COM (short username oryx)
I20260808 08:47:50.992672 19120 webserver.cc:460] Webserver started at http://127.8.149.65:41109/ using document root <none> and password file <none>
I20260808 08:47:50.993345 19120 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:50.993507 19120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:50.993800 19120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:50.996493 19120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "207354ebcfae4f84863ac0244cac8265"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "2eba04b252039d3b1c42d202c10ee428"
server_key_iv: "8359c0dde43a6cfeccabdd404a1d4768"
server_key_version: "encryptionkey@0"
I20260808 08:47:50.997207 19120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "207354ebcfae4f84863ac0244cac8265"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "2eba04b252039d3b1c42d202c10ee428"
server_key_iv: "8359c0dde43a6cfeccabdd404a1d4768"
server_key_version: "encryptionkey@0"
I20260808 08:47:51.002085 19120 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:47:51.005468 19148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.006875 19120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:51.007056 19120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "207354ebcfae4f84863ac0244cac8265"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "2eba04b252039d3b1c42d202c10ee428"
server_key_iv: "8359c0dde43a6cfeccabdd404a1d4768"
server_key_version: "encryptionkey@0"
I20260808 08:47:51.007261 19120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:51.031237 19120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:51.035524 19120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:51.035806 19120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:51.036803 19120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:51.038122 19120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:51.038226 19120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.038371 19120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:51.038442 19120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.072661 19120 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34231
I20260808 08:47:51.072762 19318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34231 every 8 connection(s)
I20260808 08:47:51.073891 19120 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:51.081748 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 19120
I20260808 08:47:51.081967 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:47:51.082883 8789 external_mini_cluster.cc:1428] Setting key 04902e987829b7113668f828eb24ce02
Aug 08 08:47:51 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178870, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:51.094619 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:51.076483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:39107 (local address 127.8.149.126:41123)
0808 08:47:51.076946 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:51.076952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:51.077968 (+ 1016us) server_negotiation.cc:407] Connection header received
0808 08:47:51.079738 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:51.079742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:51.079805 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:51.079897 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:51.081327 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.082191 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.084442 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.084985 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.085139 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:51.088767 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:51.088772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:51.088775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:51.088805 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:51.091385 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:51.092171 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:51.092175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:51.092177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:51.092306 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:51.092766 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:51.092772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:51.092781 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:51.093044 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:51.093217 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:51.093948 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 08:47:51.094177 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":213,"threads_started":1}
I20260808 08:47:51.095481 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:51.077015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:39107)
0808 08:47:51.077757 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:51.077806 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:51.079447 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:51.080143 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:51.080159 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:51.080660 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:51.081180 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:51.081196 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.082337 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.082343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:51.084268 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:51.084280 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.085206 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.085213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:51.085459 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:51.086133 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:51.086154 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:51.088557 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:51.091548 (+ 2991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:51.091557 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:51.091570 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:51.092002 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:51.092437 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:51.092442 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:51.092446 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:51.092637 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:51.093212 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:51.093220 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:51.093555 (+ 335us) client_negotiation.cc:769] Sending connection context
0808 08:47:51.093835 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 08:47:51.094321 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":276,"threads_started":1}
I20260808 08:47:51.097054 19319 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:51.097381 19319 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:51.098062 19319 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:51.100319 19023 ts_manager.cc:194] Registered new tserver with Master: 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:51.102495 19023 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:39107
WARNING: no policy specified for oryx/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
I20260808 08:47:51.137315 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:51.464272 19329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:51.464532 19329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:51.464618 19329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:51.471385 19329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:51.471475 19329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:51.471572 19329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:51.483572 19329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:51.484998 19329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:51.486573 19329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:51.500639 19334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:51.500671 19335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:51.501088 19338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:51.501528 19329 server_base.cc:1034] running on GCE node
I20260808 08:47:51.502027 19329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:51.502866 19329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:51.504055 19329 hybrid_clock.cc:648] HybridClock initialized: now 1786178871504007 us; error 51 us; skew 500 ppm
I20260808 08:47:51.504392 19329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:51 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178871, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:51.510692 19329 init.cc:377] Logged in from keytab as oryx/127.8.149.66@KRBTEST.COM (short username oryx)
I20260808 08:47:51.512320 19329 webserver.cc:460] Webserver started at http://127.8.149.66:32835/ using document root <none> and password file <none>
I20260808 08:47:51.512974 19329 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:51.513118 19329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:51.513410 19329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:51.516243 19329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "1112beb54a894960be11010a1c5776cb"
format_stamp: "Formatted at 2026-08-08 08:47:51 on dist-test-slave-7vjv"
server_key: "6fe833b9ca68727537c7bdfc68b2c1b8"
server_key_iv: "ba4f93d68d51a2c0788fb39728f922d7"
server_key_version: "encryptionkey@0"
I20260808 08:47:51.516985 19329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "1112beb54a894960be11010a1c5776cb"
format_stamp: "Formatted at 2026-08-08 08:47:51 on dist-test-slave-7vjv"
server_key: "6fe833b9ca68727537c7bdfc68b2c1b8"
server_key_iv: "ba4f93d68d51a2c0788fb39728f922d7"
server_key_version: "encryptionkey@0"
I20260808 08:47:51.522105 19329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:51.526021 19352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.527238 19329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 08:47:51.527423 19329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "1112beb54a894960be11010a1c5776cb"
format_stamp: "Formatted at 2026-08-08 08:47:51 on dist-test-slave-7vjv"
server_key: "6fe833b9ca68727537c7bdfc68b2c1b8"
server_key_iv: "ba4f93d68d51a2c0788fb39728f922d7"
server_key_version: "encryptionkey@0"
I20260808 08:47:51.527657 19329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:51.549464 19329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:51.553082 19329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:51.553366 19329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:51.554247 19329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:51.555435 19329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:51.555532 19329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.555665 19329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:51.555732 19329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:51.587992 19329 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:45607
I20260808 08:47:51.588042 19524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:45607 every 8 connection(s)
I20260808 08:47:51.589232 19329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:51.599248 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 19329
I20260808 08:47:51.599427 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:47:51.599893 8789 external_mini_cluster.cc:1428] Setting key 45c21993e042585f1ded97d64298eb92
Aug 08 08:47:51 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178871, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:51.608204 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:51.591688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:55541 (local address 127.8.149.126:41123)
0808 08:47:51.591868 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:51.591872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:51.593048 (+ 1176us) server_negotiation.cc:407] Connection header received
0808 08:47:51.594837 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:51.594843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:51.594936 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:51.595075 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:51.596525 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.597215 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.598633 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.599162 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.599299 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:51.602867 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:51.602872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:51.602875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:51.602912 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:51.605313 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:51.605959 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:51.605968 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:51.605970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:51.606089 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:51.606554 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:51.606559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:51.606564 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:51.606812 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:51.606985 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:51.607612 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 08:47:51.607822 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:47:51.608978 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:51.592195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:55541)
0808 08:47:51.592884 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:51.592927 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:51.594573 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:51.595302 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:51.595310 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:51.595782 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:51.596356 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:51.596373 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.597376 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.597380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:51.598496 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:51.598507 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:51.599508 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:51.599522 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:51.599725 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:51.600485 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:51.600515 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:51.602643 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:51.605446 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:51.605453 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:51.605465 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:51.605833 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:51.606223 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:51.606228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:51.606231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:51.606437 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:51.606959 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:51.606966 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:51.607242 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 08:47:51.607496 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 08:47:51.607934 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":273,"threads_started":1}
I20260808 08:47:51.610354 19525 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:51.610661 19525 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:51.611459 19525 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:51.612882 19023 ts_manager.cc:194] Registered new tserver with Master: 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607)
I20260808 08:47:51.613658 19023 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:55541
WARNING: no policy specified for oryx/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
I20260808 08:47:51.654870 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:51.975304 19535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:51.975559 19535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:51.975649 19535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:51.982538 19535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:51.982628 19535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:51.982722 19535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:51.991371 19535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41123
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:51.992594 19535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:51.993796 19535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:52.006453 19544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:52.006409 19545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:52.006486 19548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:52.007231 19535 server_base.cc:1034] running on GCE node
I20260808 08:47:52.007855 19535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:52.008937 19535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:52.010164 19535 hybrid_clock.cc:648] HybridClock initialized: now 1786178872010066 us; error 84 us; skew 500 ppm
I20260808 08:47:52.010468 19535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:52.013700 19535 init.cc:377] Logged in from keytab as oryx/127.8.149.67@KRBTEST.COM (short username oryx)
I20260808 08:47:52.015165 19535 webserver.cc:460] Webserver started at http://127.8.149.67:41575/ using document root <none> and password file <none>
I20260808 08:47:52.015784 19535 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:52.015914 19535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:52.016485 19535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:52.019721 19535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "9f840c779bd0478b9736ac42ef36cd8c"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "8022bbc2768aec655104b9791bf9ead7"
server_key_iv: "d94bfac98a789c53abb61146c4a58125"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.020599 19535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "9f840c779bd0478b9736ac42ef36cd8c"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "8022bbc2768aec655104b9791bf9ead7"
server_key_iv: "d94bfac98a789c53abb61146c4a58125"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.026181 19535 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:47:52.029557 19557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.030880 19535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:47:52.031101 19535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "9f840c779bd0478b9736ac42ef36cd8c"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "8022bbc2768aec655104b9791bf9ead7"
server_key_iv: "d94bfac98a789c53abb61146c4a58125"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.031318 19535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:52.049219 19535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:52.052956 19535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:52.053243 19535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:52.054117 19535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:52.055379 19535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:52.055490 19535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.055639 19535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:52.055709 19535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.092321 19535 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:35187
I20260808 08:47:52.092365 19739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:35187 every 8 connection(s)
I20260808 08:47:52.093524 19535 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:52.095893 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 19535
I20260808 08:47:52.096141 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:47:52.096711 8789 external_mini_cluster.cc:1428] Setting key aa0891e85ca0c64f7b2e935331d3c0fd
I20260808 08:47:52.105507 19319 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:52.116822 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.096234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:41205 (local address 127.8.149.126:41123)
0808 08:47:52.096446 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.096454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.097798 (+ 1344us) server_negotiation.cc:407] Connection header received
0808 08:47:52.099662 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.099668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.099789 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.099902 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.102036 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.103048 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.104584 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.105019 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.105156 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.109903 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.109911 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.109918 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.109961 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.114192 (+ 4231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.114834 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.114837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.114840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.114970 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.115319 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.115322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.115324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.115593 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.115701 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.116300 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.116525 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:47:52.117610 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.096669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:41205)
0808 08:47:52.097592 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.097634 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.099403 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.100249 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.100257 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.100960 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.101799 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.101825 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.103209 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.103214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.104450 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.104462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.105309 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.105319 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.105627 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.106455 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.106497 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.109669 (+ 3172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.114330 (+ 4661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.114336 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.114346 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.114728 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.115060 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.115063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.115065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.115225 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.115692 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.115697 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.115951 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.116207 (+ 256us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.116585 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":401,"threads_started":1}
I20260808 08:47:52.119071 19740 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:52.119382 19740 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:52.120198 19740 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:52.121594 19023 ts_manager.cc:194] Registered new tserver with Master: 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187)
I20260808 08:47:52.122394 19023 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:41205
I20260808 08:47:52.124740 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.149.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.125.keytab.
Entry for principal oryx/127.8.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.125.keytab.
I20260808 08:47:52.179911 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:38801
--webserver_interface=127.8.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.125.keytab
--principal=oryx/127.8.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41123,127.8.149.125:38801
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:52.502651 19747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:52.502890 19747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:52.503062 19747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:52.509958 19747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:52.510051 19747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:52.510128 19747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:52.510216 19747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:52.510295 19747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:52.519645 19747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41123,127.8.149.125:38801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.125.keytab
--principal=oryx/127.8.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:38801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
W20260808 08:47:52.520011 19747 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.8.149.126:41123,127.8.149.125:38801'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 08:47:52.521227 19747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:52.522524 19747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:52.533968 19753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:52.534039 19755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:52.534046 19757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:52.535120 19747 server_base.cc:1034] running on GCE node
I20260808 08:47:52.535897 19747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:52.537210 19747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:52.538420 19747 hybrid_clock.cc:648] HybridClock initialized: now 1786178872538369 us; error 27 us; skew 500 ppm
I20260808 08:47:52.538717 19747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:52.541859 19747 init.cc:377] Logged in from keytab as oryx/127.8.149.125@KRBTEST.COM (short username oryx)
I20260808 08:47:52.543156 19747 webserver.cc:460] Webserver started at http://127.8.149.125:34205/ using document root <none> and password file <none>
I20260808 08:47:52.543798 19747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:52.543918 19747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:52.544293 19747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:52.546993 19747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/instance:
uuid: "f5c819b4b508438fbdda67d3ef352db0"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "ee48a7676e2aa9ce6034f2c7eda5dbaf"
server_key_iv: "bcf9bbc00db407e8bd59961d7a8a7f41"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.547765 19747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal/instance:
uuid: "f5c819b4b508438fbdda67d3ef352db0"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "ee48a7676e2aa9ce6034f2c7eda5dbaf"
server_key_iv: "bcf9bbc00db407e8bd59961d7a8a7f41"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.552723 19747 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:47:52.556200 19768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.557502 19747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:47:52.557675 19747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "f5c819b4b508438fbdda67d3ef352db0"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "ee48a7676e2aa9ce6034f2c7eda5dbaf"
server_key_iv: "bcf9bbc00db407e8bd59961d7a8a7f41"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.557921 19747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:52.581501 19747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:52.585726 19747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:52.585985 19747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:52.605562 19747 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.125:38801
I20260808 08:47:52.605584 19855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.125:38801 every 8 connection(s)
I20260808 08:47:52.606762 19747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
I20260808 08:47:52.610302 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:52.610343 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 19747
I20260808 08:47:52.616832 19525 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
I20260808 08:47:52.619750 19857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
I20260808 08:47:52.634033 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.612586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.8.149.125:38801)
0808 08:47:52.613298 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.613308 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.613350 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:47:52.615060 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.615080 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.615433 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.615776 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.617428 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.619372 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.620652 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.621637 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.621820 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.626388 (+ 4568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.626395 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.626406 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.626442 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.629986 (+ 3544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.630620 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.630627 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.630634 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.630829 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.631217 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.631222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.631225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.631795 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.632051 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.632487 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.632944 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":327,"threads_started":1}
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.125@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:52.642588 19864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.622537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59024)
0808 08:47:52.628700 (+ 6163us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.628746 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.628895 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.629595 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.629599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.630284 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.630507 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.630539 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.631814 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.631817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.633310 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.633322 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.634336 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.634342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.634531 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.635222 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.635243 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.637549 (+ 2306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.640380 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.640388 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.640393 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.640787 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.641181 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.641184 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.641186 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.641298 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.641783 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.641788 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.641913 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.642049 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.642318 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5877,"thread_start_us":5732,"threads_started":1}
I20260808 08:47:52.642684 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.622548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59024 (local address 127.8.149.126:41123)
0808 08:47:52.629273 (+ 6725us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.629278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.629297 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:52.629352 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.629356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.629437 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.629545 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.630667 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.631687 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.633468 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.634080 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.634226 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.637719 (+ 3493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.637724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.637727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.637758 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.640261 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.640953 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.640957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.640959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.641085 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.641391 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.641395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.641398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.641679 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.641789 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.642149 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.642398 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6617,"thread_start_us":6512,"threads_started":1}
I20260808 08:47:52.644286 19857 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.125@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
I20260808 08:47:52.655547 19864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.644846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45618)
0808 08:47:52.645034 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.645052 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.645140 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.645432 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.645436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.645754 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.645866 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.645874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.646748 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.646753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.647562 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.647573 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.648246 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.648251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.648447 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.648915 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.648929 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.650596 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.653267 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.653274 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.653277 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.653617 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.653950 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.653955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.653958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.654141 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.654623 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.654628 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.654780 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.654919 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.655189 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":17}
I20260808 08:47:52.655627 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.644966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45618 (local address 127.8.149.125:38801)
0808 08:47:52.645110 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.645116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.645131 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:47:52.645258 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.645264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.645315 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.645416 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.645995 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.646613 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.647699 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.648062 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.648238 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.650765 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.650777 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.650780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.650803 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.653143 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.653725 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.653731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.653734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.653840 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.654243 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.654247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.654251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.654501 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.654652 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.654990 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.655326 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":49}
I20260808 08:47:52.659953 19857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Bootstrap starting.
I20260808 08:47:52.663017 19857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:52.663940 19857 log.cc:824] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:52.666407 19857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: No bootstrap required, opened a new log
I20260808 08:47:52.673105 19857 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } }
I20260808 08:47:52.673363 19857 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:52.673441 19857 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c819b4b508438fbdda67d3ef352db0, State: Initialized, Role: FOLLOWER
I20260808 08:47:52.673892 19857 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } }
I20260808 08:47:52.674563 19868 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } } }
I20260808 08:47:52.674871 19868 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:52.675446 19857 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:47:52.683902 19883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:47:52.684026 19883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:47:52.687655 19747 master_runner.cc:428] Detected that this master f5c819b4b508438fbdda67d3ef352db0 is joining an existing cluster
I20260808 08:47:52.687772 19747 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.149.125:38801
I20260808 08:47:52.718549 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.692321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45630 (local address 127.8.149.125:38801)
0808 08:47:52.692516 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.692522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.701507 (+ 8985us) server_negotiation.cc:407] Connection header received
0808 08:47:52.701710 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.701723 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.701797 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.701924 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.703190 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.704276 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.706714 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.707427 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.707530 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.710841 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.710847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.710851 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.710886 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.714823 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.715870 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.715876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.715879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.716061 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.716723 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.716728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.716731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.717097 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.717265 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.717866 (+ 601us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.718113 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:47:52.718557 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.691952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59032 (local address 127.8.149.126:41123)
0808 08:47:52.692205 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.692213 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.700793 (+ 8580us) server_negotiation.cc:407] Connection header received
0808 08:47:52.701132 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.701138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.701237 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.701311 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.702922 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.704139 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.706728 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.707427 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.707530 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.710891 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.710898 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.710902 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.710961 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.714751 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.715897 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.715903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.715906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.716072 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.716732 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.716737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.716741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.717129 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.717266 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.717917 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.718177 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:47:52.719785 19892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.692679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45630)
0808 08:47:52.701399 (+ 8720us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.701415 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.701570 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.702013 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.702017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.702619 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.702992 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.703025 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.704580 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.704585 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.706546 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.706565 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.707854 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.707862 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.708142 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.709092 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.709126 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.710662 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.714970 (+ 4308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.714976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.714979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.715713 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.716251 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.716256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.716260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.716579 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.717352 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.717370 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.717575 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.718787 (+ 1212us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.719100 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8590,"mutex_wait_us":221,"spinlock_wait_cycles":55808,"thread_start_us":8359,"threads_started":1}
I20260808 08:47:52.719920 19891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.692291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59032)
0808 08:47:52.700677 (+ 8386us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.700700 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.700916 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.701542 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.701547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.702304 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.702731 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.702746 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.704323 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.704330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.706550 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.706565 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.707890 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.707897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.708239 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.709188 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.709213 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.710639 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.714923 (+ 4284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.714928 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.714931 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.715704 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.716251 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.716256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.716260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.716579 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.717352 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.717361 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.717629 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.718744 (+ 1115us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.719340 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8244,"mutex_wait_us":515,"spinlock_wait_cycles":10496,"thread_start_us":8119,"threads_started":1}
WARNING: no policy specified for oryx/127.8.149.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.124@KRBTEST.COM" created.
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178870, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.126@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
I20260808 08:47:52.748066 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.726932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.8.149.125:38801)
0808 08:47:52.727119 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.727126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.734855 (+ 7729us) server_negotiation.cc:407] Connection header received
0808 08:47:52.735251 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.735259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.735383 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.735505 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.736843 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.737543 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.738739 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.739169 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.739298 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.742507 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.742512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.742515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.742542 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.745409 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.746062 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.746068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.746071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.746216 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.746627 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.746636 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.746638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.746887 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.747046 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.747498 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.747698 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:47:52.748178 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.726849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45636)
0808 08:47:52.734715 (+ 7866us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.734763 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.735005 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.735769 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.735774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.736483 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.736678 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.736686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.737675 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.737681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.738606 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.738618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.739309 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.739314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.739533 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.740201 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.740218 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.742323 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.745533 (+ 3210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.745545 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.745552 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.745937 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.746329 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.746334 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.746337 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.746487 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.747018 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.747025 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.747218 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.747386 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.747698 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7585,"thread_start_us":7452,"threads_started":1}
I20260808 08:47:52.750437 19023 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.149.125:38801: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0"
member_type: NON_VOTER
last_known_addr {
host: "127.8.149.125"
port: 38801
}
attrs {
promote: true
}
}
dest_uuid: "9959d16b17444ea993f89612790369c1"
cas_config_opid_index: -1
I20260808 08:47:52.751929 19023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } }
I20260808 08:47:52.755579 19902 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.124.keytab.
Entry for principal oryx/127.8.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.124.keytab.
I20260808 08:47:52.757401 19819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:52.758601 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:45897
--webserver_interface=127.8.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.124.keytab
--principal=oryx/127.8.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:47:52.761565 19819 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 08:47:52.762872 19904 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:52.760972 19902 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.149.125:38801
I20260808 08:47:52.765304 19747 master.cc:537] Master@127.8.149.125:38801 shutting down...
I20260808 08:47:52.765553 19903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } }
I20260808 08:47:52.766011 19903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
W20260808 08:47:52.766263 19000 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 08:47:52.781432 19000 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 -> Peer f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125:38801): Couldn't send request to peer f5c819b4b508438fbdda67d3ef352db0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:47:52.781749 19747 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:52.782089 19747 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:52.782269 19747 tablet_replica.cc:330] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: stopping tablet replica
I20260808 08:47:52.788664 19747 master.cc:552] Master@127.8.149.125:38801 shutdown complete.
I20260808 08:47:52.788777 19747 master_runner.cc:305] Clearing existing system tablet
I20260808 08:47:52.789163 19747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:52.789274 19747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:52.791316 19747 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 08:47:52.792896 19913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.793174 19747 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:52.793447 19747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260808 08:47:52.793529 19747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "f5c819b4b508438fbdda67d3ef352db0"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "ee48a7676e2aa9ce6034f2c7eda5dbaf"
server_key_iv: "bcf9bbc00db407e8bd59961d7a8a7f41"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.797258 19747 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:52.802726 19747 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:47:52.802908 19747 log.cc:1196] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 08:47:52.803292 19747 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Deleting consensus metadata
I20260808 08:47:52.803542 19747 master_runner.cc:315] Copying system tablet from 127.8.149.126:41123
I20260808 08:47:52.806025 19747 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: tablet copy: Beginning tablet copy session from remote peer at address 127.8.149.126:41123
I20260808 08:47:52.820078 19861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.806851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59034 (local address 127.8.149.126:41123)
0808 08:47:52.807055 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:52.807063 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:52.808655 (+ 1592us) server_negotiation.cc:407] Connection header received
0808 08:47:52.808874 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:52.808879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:52.808954 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:52.809054 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:52.809998 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.810778 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.812041 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.812774 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.812906 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.814708 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:52.814714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:52.814721 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:52.814760 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:52.817386 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.818035 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.818042 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.818045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.818177 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:52.818605 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:52.818611 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:52.818616 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:52.818877 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:52.819034 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:52.819503 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 08:47:52.819719 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:47:52.820148 19922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:52.806814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59034)
0808 08:47:52.808547 (+ 1733us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:52.808562 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:52.808730 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:52.809082 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:52.809086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:52.809552 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:52.809791 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.809812 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.810977 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.810981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.811817 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:52.811827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:52.812928 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:52.812933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:52.813118 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:52.813766 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:52.813785 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:52.814500 (+ 715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:52.817551 (+ 3051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.817556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.817560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.817918 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.818341 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:52.818350 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:52.818355 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:52.818495 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:52.818995 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:52.818999 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:52.819170 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 08:47:52.819326 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:47:52.819698 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1617,"thread_start_us":1521,"threads_started":1}
I20260808 08:47:52.821219 19060 tablet_copy_service.cc:140] P 9959d16b17444ea993f89612790369c1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f5c819b4b508438fbdda67d3ef352db0 ({username='oryx', principal='oryx/127.8.149.125@KRBTEST.COM'} at 127.0.0.1:59034)
I20260808 08:47:52.821591 19060 tablet_copy_service.cc:161] P 9959d16b17444ea993f89612790369c1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f5c819b4b508438fbdda67d3ef352db0 at {username='oryx', principal='oryx/127.8.149.125@KRBTEST.COM'} at 127.0.0.1:59034: session id = f5c819b4b508438fbdda67d3ef352db0-00000000000000000000000000000000
I20260808 08:47:52.825361 19060 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:47:52.827430 19747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:47:52.832274 19747 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: tablet copy: Starting download of 0 data blocks...
I20260808 08:47:52.832598 19747 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: tablet copy: Starting download of 1 WAL segments...
I20260808 08:47:52.835800 19747 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:47:52.838927 19060 tablet_copy_service.cc:342] P 9959d16b17444ea993f89612790369c1: Request end of tablet copy session f5c819b4b508438fbdda67d3ef352db0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.149.125@KRBTEST.COM'} at 127.0.0.1:59034
I20260808 08:47:52.839140 19060 tablet_copy_service.cc:433] P 9959d16b17444ea993f89612790369c1: ending tablet copy session f5c819b4b508438fbdda67d3ef352db0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f5c819b4b508438fbdda67d3ef352db0
I20260808 08:47:52.849792 19747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:52.852317 19923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:52.857559 19924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:52.868305 19747 server_base.cc:1034] running on GCE node
W20260808 08:47:52.869189 19928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:52.869594 19747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:52.870244 19747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:52.871459 19747 hybrid_clock.cc:648] HybridClock initialized: now 1786178872871385 us; error 54 us; skew 500 ppm
I20260808 08:47:52.871686 19747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:52 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178872, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:52.873617 19747 init.cc:377] Logged in from keytab as oryx/127.8.149.125@KRBTEST.COM (short username oryx)
I20260808 08:47:52.877023 19747 webserver.cc:460] Webserver started at http://127.8.149.125:45905/ using document root <none> and password file <none>
I20260808 08:47:52.877336 19747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:52.877434 19747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:52.879818 19747 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 08:47:52.881579 19941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:52.882042 19747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 08:47:52.882190 19747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "f5c819b4b508438fbdda67d3ef352db0"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "ee48a7676e2aa9ce6034f2c7eda5dbaf"
server_key_iv: "bcf9bbc00db407e8bd59961d7a8a7f41"
server_key_version: "encryptionkey@0"
I20260808 08:47:52.882345 19747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:52.905797 19747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:52.909114 19747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:52.949573 19747 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.125:38801
I20260808 08:47:52.949595 20016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.125:38801 every 8 connection(s)
I20260808 08:47:52.950546 19747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
I20260808 08:47:52.957698 20017 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:47:52.963012 20017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Bootstrap starting.
I20260808 08:47:52.977203 20017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:47:52.977677 20017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: Bootstrap complete.
I20260808 08:47:52.978484 20017 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } }
I20260808 08:47:52.978713 20017 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5c819b4b508438fbdda67d3ef352db0, State: Initialized, Role: LEARNER
I20260808 08:47:52.978964 20017 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } }
I20260808 08:47:52.979809 20021 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } }
I20260808 08:47:52.980145 20017 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:52.980194 20021 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:47:52.989935 20041 catalog_manager.cc:1259] Loaded cluster ID: d4e260686e7a45dc9036d19dee59779e
I20260808 08:47:52.990088 20041 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: loading cluster ID for follower catalog manager: success
I20260808 08:47:52.992528 20041 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: acquiring CA information for follower catalog manager: success
I20260808 08:47:52.994289 20041 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:47:53.125473 19740 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
I20260808 08:47:53.214087 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.206170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45650)
0808 08:47:53.206522 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.206546 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.206720 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.207799 (+ 1079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.207806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.207839 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:53.208271 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.208286 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.210124 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.210130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.211796 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.211810 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.213415 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.213423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.213604 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.213651 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.213715 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.213864 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260808 08:47:53.215211 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.206400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45650 (local address 127.8.149.125:38801)
0808 08:47:53.207451 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.207455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.207478 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:53.207539 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.207543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.207607 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.207744 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:53.208455 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.209970 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.212143 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.213189 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.214538 (+ 1349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.214738 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.214784 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.214885 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":922,"thread_start_us":624,"threads_started":1}
I20260808 08:47:53.216794 19983 raft_consensus.cc:1203] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 08:47:53.217519 20021 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9959d16b17444ea993f89612790369c1. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } }
I20260808 08:47:53.217792 20021 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: LEARNER
W20260808 08:47:53.314647 19911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:53.314936 19911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:53.315125 19911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:53.323159 19911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:47:53.323253 19911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:53.323349 19911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:53.323446 19911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:47:53.323520 19911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:47:53.335448 19911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.124.keytab
--principal=oryx/127.8.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:45897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:53.336897 19911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:53.338258 19911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:53.353216 20054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:53.353335 20050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:53.353757 20051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:53.354941 19911 server_base.cc:1034] running on GCE node
I20260808 08:47:53.355722 19911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:53.357213 19911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:53.358496 19911 hybrid_clock.cc:648] HybridClock initialized: now 1786178873358380 us; error 57 us; skew 500 ppm
I20260808 08:47:53.358916 19911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178873, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:53.362921 19911 init.cc:377] Logged in from keytab as oryx/127.8.149.124@KRBTEST.COM (short username oryx)
I20260808 08:47:53.364691 19911 webserver.cc:460] Webserver started at http://127.8.149.124:38399/ using document root <none> and password file <none>
I20260808 08:47:53.365409 19911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:53.365564 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:53.366001 19911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:47:53.369447 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/instance:
uuid: "844376a1c37943148b022aef27108cb9"
format_stamp: "Formatted at 2026-08-08 08:47:53 on dist-test-slave-7vjv"
server_key: "5604e158461c2fcb633be9c893661350"
server_key_iv: "0fc6fda9ba4d92b8b65a0363e1bfbc09"
server_key_version: "encryptionkey@0"
I20260808 08:47:53.370352 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal/instance:
uuid: "844376a1c37943148b022aef27108cb9"
format_stamp: "Formatted at 2026-08-08 08:47:53 on dist-test-slave-7vjv"
server_key: "5604e158461c2fcb633be9c893661350"
server_key_iv: "0fc6fda9ba4d92b8b65a0363e1bfbc09"
server_key_version: "encryptionkey@0"
I20260808 08:47:53.376185 19911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:47:53.380664 20068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:53.382097 19911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:47:53.382344 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "844376a1c37943148b022aef27108cb9"
format_stamp: "Formatted at 2026-08-08 08:47:53 on dist-test-slave-7vjv"
server_key: "5604e158461c2fcb633be9c893661350"
server_key_iv: "0fc6fda9ba4d92b8b65a0363e1bfbc09"
server_key_version: "encryptionkey@0"
I20260808 08:47:53.382791 19911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:53.407698 19911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:53.413105 19911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:53.413450 19911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:53.439245 19911 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.124:45897
I20260808 08:47:53.439275 20144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.124:45897 every 8 connection(s)
I20260808 08:47:53.440791 19911 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
I20260808 08:47:53.443394 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 19911
I20260808 08:47:53.445506 20149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:53.453358 20149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178873, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.124@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:53.468541 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.445683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39130 (local address 127.8.149.124:45897)
0808 08:47:53.446547 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.446558 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.446598 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:47:53.448281 (+ 1683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.448301 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.448648 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.449176 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.450638 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.451962 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.453219 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.453923 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.454118 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.459985 (+ 5867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.459993 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.460003 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.460038 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.463695 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.464492 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.464499 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.464504 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.464722 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.465186 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.465192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.465196 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.465803 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.466062 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.466614 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.467103 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":365,"threads_started":1}
I20260808 08:47:53.473510 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.455937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59036)
0808 08:47:53.456902 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.456958 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.457288 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.457933 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.457938 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.458794 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.459185 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.459200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.460371 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.460382 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.461874 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.461890 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.462982 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.462987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.463109 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.463692 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.463708 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.466056 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.470970 (+ 4914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.470979 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.470988 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.471564 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.472022 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.472025 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.472027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.472225 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.472716 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.472721 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.472853 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.473030 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.473248 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":424,"threads_started":1}
I20260808 08:47:53.473673 20156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.456168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59036 (local address 127.8.149.126:41123)
0808 08:47:53.457383 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.457389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.457410 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:47:53.457473 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.457478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.457556 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.457865 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.459375 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.460208 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.462067 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.462791 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.462955 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.466253 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.466281 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.466285 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.466334 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.470803 (+ 4469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.471706 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.471714 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.471723 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.471915 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.472322 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.472326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.472328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.472606 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.472729 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.473205 (+ 476us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.473381 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1099,"thread_start_us":973,"threads_started":1}
I20260808 08:47:53.475204 20149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178873, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.124@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
I20260808 08:47:53.488445 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.475951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45660 (local address 127.8.149.125:38801)
0808 08:47:53.476324 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.476331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.476354 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:53.476414 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.476418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.476475 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.476577 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.477179 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.477902 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.479116 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.479524 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.479675 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.483157 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.483163 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.483168 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.483207 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.485828 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.486552 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.486559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.486562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.486702 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.487069 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.487075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.487078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.487399 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.487566 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.487943 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.488200 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235}
I20260808 08:47:53.488472 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.475920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45660)
0808 08:47:53.476132 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.476149 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.476239 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.476595 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.476599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.476916 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.477031 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.477038 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.478021 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.478027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.478975 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.478985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.479693 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.479699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.479963 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.480594 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.480615 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.482957 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.485989 (+ 3032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.485996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.486000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.486445 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.486813 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.486819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.486822 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.486963 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.487529 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.487534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.487676 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.487818 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.488151 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 08:47:53.489672 20149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178873, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.124@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
I20260808 08:47:53.502573 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.490423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.8.149.124:45897)
0808 08:47:53.490566 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.490570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.490585 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:47:53.490619 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.490622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.490665 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.490734 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.491385 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.492030 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.493268 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.493662 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.493749 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.496613 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.496619 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.496640 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.496686 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.499775 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.500591 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.500595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.500597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.500708 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.501179 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.501182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.501184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.501433 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.501537 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.501971 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.502287 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":135,"server-negotiator.queue_time_us":56}
I20260808 08:47:53.502650 20154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.490273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.0.0.1:39134)
0808 08:47:53.490411 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.490429 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.490525 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.490770 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.490773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.491122 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.491269 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.491276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.492191 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.492195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.493148 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.493159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.493812 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.493816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.494021 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.494472 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.494488 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.496402 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.499921 (+ 3519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.499929 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.499935 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.500485 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.500820 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.500826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.500831 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.501058 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.501552 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.501557 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.501736 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.501873 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.502150 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 08:47:53.507441 20149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Bootstrap starting.
I20260808 08:47:53.510803 20149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:53.511855 20149 log.cc:824] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:53.514427 20149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: No bootstrap required, opened a new log
I20260808 08:47:53.521375 20149 raft_consensus.cc:348] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } }
I20260808 08:47:53.521699 20149 raft_consensus.cc:374] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:53.521840 20149 raft_consensus.cc:729] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 844376a1c37943148b022aef27108cb9, State: Initialized, Role: FOLLOWER
I20260808 08:47:53.522451 20149 consensus_queue.cc:260] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } }
I20260808 08:47:53.523393 20158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } } }
I20260808 08:47:53.523794 20158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:53.524621 20149 sys_catalog.cc:564] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:47:53.534235 20175 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:47:53.534386 20175 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:47:53.538795 19911 master_runner.cc:428] Detected that this master 844376a1c37943148b022aef27108cb9 is joining an existing cluster
I20260808 08:47:53.538910 19911 master_runner.cc:432] Initiating AddMaster RPC to add 127.8.149.124:45897
I20260808 08:47:53.569358 20156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.543747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.8.149.126:41123)
0808 08:47:53.544033 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.544042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.548716 (+ 4674us) server_negotiation.cc:407] Connection header received
0808 08:47:53.549026 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.549034 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.549157 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.549241 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.551180 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.552668 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.555464 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.556408 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.556529 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.560892 (+ 4363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.560901 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.560909 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.560957 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.565535 (+ 4578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.566650 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.566658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.566664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.566898 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.567507 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.567514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.567520 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.567981 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.568161 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.568786 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.569011 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:47:53.570245 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.543368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59042)
0808 08:47:53.548566 (+ 5198us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.548588 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.548818 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.549508 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.549516 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.550496 (+ 980us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.550963 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.550979 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.552941 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.552949 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.555236 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.555260 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.556902 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.556911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.557167 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.558114 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.558147 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.559679 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.565784 (+ 6105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.565791 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.565797 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.566484 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.567089 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.567096 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.567102 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.567346 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.568282 (+ 936us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.568290 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.568530 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.568702 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.569305 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5051,"thread_start_us":16639,"threads_started":1}
I20260808 08:47:53.574939 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 19120
I20260808 08:47:53.577718 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.543431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45670 (local address 127.8.149.125:38801)
0808 08:47:53.543636 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.543643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.560595 (+ 16952us) server_negotiation.cc:407] Connection header received
0808 08:47:53.560811 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.560819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.560903 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.561004 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.562446 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.563625 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.565886 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.566588 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.566685 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.570258 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.570265 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.570269 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.570308 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.574006 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.574867 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.574875 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.574879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.575068 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.575564 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.575572 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.575577 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.575934 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.576068 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.576771 (+ 703us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.577142 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:47:53.579195 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.543549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45670)
0808 08:47:53.560449 (+ 16900us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.560472 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.560626 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.561175 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.561180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.561899 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.562255 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.562271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.563838 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.563843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.565715 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.565730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.567000 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.567007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.567169 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.567885 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.567906 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.569161 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.574171 (+ 5010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.574175 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.574178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.574694 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.575241 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.575246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.575250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.575420 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.576176 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.576183 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.576398 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.577969 (+ 1571us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.578437 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16695,"thread_start_us":4683,"threads_started":1}
I20260808 08:47:53.586951 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.548789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39146 (local address 127.8.149.124:45897)
0808 08:47:53.548957 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.548963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.568776 (+ 19813us) server_negotiation.cc:407] Connection header received
0808 08:47:53.569009 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.569014 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.569077 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.569145 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.570606 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.571680 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.573689 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.574512 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.574596 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.578063 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.578072 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.578079 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.578122 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.583148 (+ 5026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.584342 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.584349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.584355 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.584500 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.584996 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.585003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.585008 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.585438 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.585625 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.586207 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.586468 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178870, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.126@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
I20260808 08:47:53.600251 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.548801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.0.0.1:39146)
0808 08:47:53.568590 (+ 19789us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.568608 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.568859 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.569313 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.569317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.570003 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.570470 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.570481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.571889 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.571894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.573520 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.573537 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.574896 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.574902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.575076 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.575627 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.575646 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.577852 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.583422 (+ 5570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.583430 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.583436 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.584208 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.584699 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.584707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.584712 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.584883 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.585701 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.585708 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.585930 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.599178 (+ 13248us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.599557 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19660,"thread_start_us":19482,"threads_started":1}
I20260808 08:47:53.608556 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.576292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39152 (local address 127.8.149.124:45897)
0808 08:47:53.587219 (+ 10927us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.587227 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.587247 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:47:53.587353 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.587356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.587428 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.588451 (+ 1023us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.588636 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.589702 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.591582 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.592805 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.597859 (+ 5054us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.598113 (+ 254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.598121 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.598128 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.598166 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.604590 (+ 6424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.606804 (+ 2214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.606815 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.606817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.606922 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.607274 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.607278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.607281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.607522 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.607654 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.608016 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.608237 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10837,"thread_start_us":28667,"threads_started":1}
I20260808 08:47:53.608565 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.576009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.0.0.1:39152)
0808 08:47:53.576241 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.576257 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.576341 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.587589 (+ 11248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.587595 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.588041 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.588314 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.588325 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.589849 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.589854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.591281 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.591302 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.593052 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.593060 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.593271 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.594026 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.594058 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.597649 (+ 3591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.606326 (+ 8677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.606331 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.606335 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.606675 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.607036 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.607041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.607044 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.607163 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.607645 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.607649 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.607792 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.607917 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.608198 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 08:47:53.610764 19023 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.8.149.124:45897: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "844376a1c37943148b022aef27108cb9"
member_type: NON_VOTER
last_known_addr {
host: "127.8.149.124"
port: 45897
}
attrs {
promote: true
}
}
dest_uuid: "9959d16b17444ea993f89612790369c1"
cas_config_opid_index: 5
I20260808 08:47:53.611977 19023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } }
I20260808 08:47:53.614375 19903 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 844376a1c37943148b022aef27108cb9 (127.8.149.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.65@KRBTEST.COM
I20260808 08:47:53.617038 20158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:53.617558 19983 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 08:47:53.617434 20158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } }
I20260808 08:47:53.621755 19903 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.8.149.124:45897
I20260808 08:47:53.632143 20191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.576476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.8.149.65:34231)
0808 08:47:53.605607 (+ 29131us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.605614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.605638 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:47:53.605690 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.605696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.605910 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.606032 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.607811 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.609343 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.610973 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.611706 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.611836 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.618379 (+ 6543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.618393 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.618409 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.618447 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.625358 (+ 6911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.626771 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.626784 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.626790 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.627080 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.627788 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.627796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.627802 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.628442 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.630578 (+ 2136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.630779 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.631290 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28980,"thread_start_us":28873,"threads_started":1}
I20260808 08:47:53.633569 20195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 08:47:53.634145 19313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:53.639955 19045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "844376a1c37943148b022aef27108cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9959d16b17444ea993f89612790369c1" is_pre_election: true
I20260808 08:47:53.641770 20111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:53.641773 19982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "844376a1c37943148b022aef27108cb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c819b4b508438fbdda67d3ef352db0" is_pre_election: true
I20260808 08:47:53.642683 19911 master.cc:537] Master@127.8.149.124:45897 shutting down...
I20260808 08:47:53.640270 19983 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 844376a1c37943148b022aef27108cb9 (127.8.149.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.643679 20158 leader_election.cc:288] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123), f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125:38801)
I20260808 08:47:53.644214 20193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.645529 20193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:53.648209 20021 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: NON_VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: true } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.648555 20021 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:47:53.648952 19903 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: attempting to promote NON_VOTER f5c819b4b508438fbdda67d3ef352db0 to VOTER
I20260808 08:47:53.648885 20069 leader_election.cc:302] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 844376a1c37943148b022aef27108cb9; no voters: 9959d16b17444ea993f89612790369c1, f5c819b4b508438fbdda67d3ef352db0
I20260808 08:47:53.650055 19903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } }
I20260808 08:47:53.652980 19982 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 LEARNER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 08:47:53.653620 20195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 08:47:53.656626 20195 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.659183 19982 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.660255 20111 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 08:47:53.662165 20158 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 08:47:53.666584 20076 tablet.cc:2369] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:53.671128 19911 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:53.671581 19911 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:53.671818 19911 tablet_replica.cc:330] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: stopping tablet replica
I20260808 08:47:53.674401 20195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.675916 20021 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.676218 20021 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:53.675330 20193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.677120 20193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:53.677367 20195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:53.680902 19911 master.cc:552] Master@127.8.149.124:45897 shutdown complete.
I20260808 08:47:53.680998 19911 master_runner.cc:305] Clearing existing system tablet
I20260808 08:47:53.681514 19911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:53.681648 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260808 08:47:53.686383 19000 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 -> Peer 844376a1c37943148b022aef27108cb9 (127.8.149.124:45897): Couldn't send request to peer 844376a1c37943148b022aef27108cb9. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260808 08:47:53.687423 19911 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 08:47:53.689821 20206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:53.690275 19911 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:53.690680 19911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:47:53.690858 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "844376a1c37943148b022aef27108cb9"
format_stamp: "Formatted at 2026-08-08 08:47:53 on dist-test-slave-7vjv"
server_key: "5604e158461c2fcb633be9c893661350"
server_key_iv: "0fc6fda9ba4d92b8b65a0363e1bfbc09"
server_key_version: "encryptionkey@0"
I20260808 08:47:53.696007 19911 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:53.704296 19911 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:47:53.704543 19911 log.cc:1196] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 08:47:53.705310 19911 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Deleting consensus metadata
I20260808 08:47:53.705621 19911 master_runner.cc:315] Copying system tablet from 127.8.149.126:41123
I20260808 08:47:53.709060 19911 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: tablet copy: Beginning tablet copy session from remote peer at address 127.8.149.126:41123
I20260808 08:47:53.729341 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.709875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59050)
0808 08:47:53.711206 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:53.711247 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:53.711438 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:53.711832 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:53.711837 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:53.712591 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:53.713072 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.713086 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.714515 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.714521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.716449 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:53.716464 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.717512 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.717518 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:53.717824 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.718718 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:53.718752 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:53.720339 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:53.725497 (+ 5158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.725503 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.725507 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.726175 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.726756 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:53.726761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:53.726765 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:53.727031 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:53.727848 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:53.727853 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:53.728076 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 08:47:53.728263 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 08:47:53.728662 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":945,"threads_started":1}
I20260808 08:47:53.730437 20156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:53.710151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59050 (local address 127.8.149.126:41123)
0808 08:47:53.710360 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:53.710366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:53.711369 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 08:47:53.711585 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:53.711591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:53.711668 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:53.711767 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:53.713244 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.714341 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.716613 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:53.717355 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:53.717485 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:53.720538 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:53.720544 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:53.720549 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:53.720586 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:53.725337 (+ 4751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.726352 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.726358 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.726362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.726629 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:53.727199 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:53.727204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:53.727208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:53.727698 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:53.727866 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:53.729702 (+ 1836us) server_negotiation.cc:299] Negotiation successful
0808 08:47:53.729940 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 08:47:53.731189 19060 tablet_copy_service.cc:140] P 9959d16b17444ea993f89612790369c1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 844376a1c37943148b022aef27108cb9 ({username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:59050)
I20260808 08:47:53.731415 19060 tablet_copy_service.cc:161] P 9959d16b17444ea993f89612790369c1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 844376a1c37943148b022aef27108cb9 at {username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:59050: session id = 844376a1c37943148b022aef27108cb9-00000000000000000000000000000000
I20260808 08:47:53.735922 19060 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:47:53.738080 19911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:47:53.747972 19911 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: tablet copy: Starting download of 0 data blocks...
I20260808 08:47:53.748457 19911 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: tablet copy: Starting download of 1 WAL segments...
I20260808 08:47:53.751587 19911 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:47:53.757807 19060 tablet_copy_service.cc:342] P 9959d16b17444ea993f89612790369c1: Request end of tablet copy session 844376a1c37943148b022aef27108cb9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:59050
I20260808 08:47:53.757948 19060 tablet_copy_service.cc:433] P 9959d16b17444ea993f89612790369c1: ending tablet copy session 844376a1c37943148b022aef27108cb9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 844376a1c37943148b022aef27108cb9
I20260808 08:47:53.769817 19911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:53.772794 20214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:53.777472 20218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:53.785616 20220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:53.785980 19911 server_base.cc:1034] running on GCE node
I20260808 08:47:53.786310 19911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:53.787101 19911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:53.788324 19911 hybrid_clock.cc:648] HybridClock initialized: now 1786178873788234 us; error 59 us; skew 500 ppm
I20260808 08:47:53.788648 19911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:53 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178873, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:53.790987 19911 init.cc:377] Logged in from keytab as oryx/127.8.149.124@KRBTEST.COM (short username oryx)
I20260808 08:47:53.796907 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 19120
I20260808 08:47:53.803678 19911 webserver.cc:460] Webserver started at http://127.8.149.124:35517/ using document root <none> and password file <none>
I20260808 08:47:53.804203 19911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:53.804399 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:53.807961 19911 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:47:53.812570 20231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:53.813158 19911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:47:53.813316 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "844376a1c37943148b022aef27108cb9"
format_stamp: "Formatted at 2026-08-08 08:47:53 on dist-test-slave-7vjv"
server_key: "5604e158461c2fcb633be9c893661350"
server_key_iv: "0fc6fda9ba4d92b8b65a0363e1bfbc09"
server_key_version: "encryptionkey@0"
I20260808 08:47:53.813627 19911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:53.834383 19911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:53.836717 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:34231
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:41123
--webserver_port=41109
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:47:53.838904 19911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:53.865391 19911 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.124:45897
I20260808 08:47:53.865449 20314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.124:45897 every 8 connection(s)
I20260808 08:47:53.866597 19911 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
I20260808 08:47:53.871819 20316 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:47:53.875664 20316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Bootstrap starting.
I20260808 08:47:53.894238 20316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:47:53.894739 20316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Bootstrap complete.
I20260808 08:47:53.895685 20316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } }
I20260808 08:47:53.895965 20316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 844376a1c37943148b022aef27108cb9, State: Initialized, Role: LEARNER
I20260808 08:47:53.896248 20316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } }
I20260808 08:47:53.897388 20316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:47:53.897181 20319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:53.897727 20319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:47:53.909085 20339 catalog_manager.cc:1259] Loaded cluster ID: d4e260686e7a45dc9036d19dee59779e
I20260808 08:47:53.909204 20339 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: loading cluster ID for follower catalog manager: success
I20260808 08:47:53.913293 20339 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: acquiring CA information for follower catalog manager: success
I20260808 08:47:53.915818 20339 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:47:54.072631 19897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.063159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.0.0.1:39154)
0808 08:47:54.063406 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:54.063436 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:54.063611 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:54.064931 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:54.064937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:54.064970 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:54.065165 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.065175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.067575 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.067581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.069624 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.069642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.071702 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.071709 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.071936 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.071976 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:47:54.072079 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:47:54.072254 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:47:54.072773 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.063614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.8.149.124:45897)
0808 08:47:54.064425 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:54.064434 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:54.064470 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:47:54.064566 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:54.064574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:54.064682 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:54.064873 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:54.065360 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.067381 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.069827 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.071481 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.071647 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.071973 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:54.072155 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 08:47:54.072333 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":399,"threads_started":1}
I20260808 08:47:54.074256 20278 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 08:47:54.075240 20319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9959d16b17444ea993f89612790369c1. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:54.075564 20319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: LEARNER
W20260808 08:47:54.252876 20246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:54.253227 20246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:54.253432 20246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:54.260701 20246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:54.260852 20246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:54.261077 20246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:47:54.270767 20246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:34231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=41109
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:54.272146 20246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:54.273569 20246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:54.288522 20352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:54.288656 20350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:54.288712 20355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:54.289757 20246 server_base.cc:1034] running on GCE node
I20260808 08:47:54.290374 20246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:54.291304 20246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:54.292541 20246 hybrid_clock.cc:648] HybridClock initialized: now 1786178874292508 us; error 63 us; skew 500 ppm
I20260808 08:47:54.292860 20246 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:54.296165 20246 init.cc:377] Logged in from keytab as oryx/127.8.149.65@KRBTEST.COM (short username oryx)
I20260808 08:47:54.297721 20246 webserver.cc:460] Webserver started at http://127.8.149.65:41109/ using document root <none> and password file <none>
I20260808 08:47:54.298460 20246 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:54.298650 20246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:54.304399 20246 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:47:54.307214 20364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:54.308620 20246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:54.308822 20246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "207354ebcfae4f84863ac0244cac8265"
format_stamp: "Formatted at 2026-08-08 08:47:50 on dist-test-slave-7vjv"
server_key: "2eba04b252039d3b1c42d202c10ee428"
server_key_iv: "8359c0dde43a6cfeccabdd404a1d4768"
server_key_version: "encryptionkey@0"
I20260808 08:47:54.309829 20246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:54.333910 20246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:54.339584 20246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:54.339913 20246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:54.344636 20246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:54.346478 20246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:54.346629 20246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:54.346740 20246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:54.346822 20246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:54.397436 20246 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34231
I20260808 08:47:54.397591 20532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34231 every 8 connection(s)
I20260808 08:47:54.399243 20246 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:47:54.408712 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 20246
I20260808 08:47:54.409018 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 19329
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.66@KRBTEST.COM
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
I20260808 08:47:54.440640 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.410626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35650 (local address 127.8.149.66:45607)
0808 08:47:54.416396 (+ 5770us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:54.416409 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:54.417139 (+ 730us) server_negotiation.cc:407] Connection header received
0808 08:47:54.417365 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:54.417374 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:54.417668 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:54.417827 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:54.421575 (+ 3748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.423615 (+ 2040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.426050 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.427168 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.427329 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.432708 (+ 5379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:54.432720 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:54.432733 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:54.432785 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:54.437037 (+ 4252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.438216 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.438224 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.438228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.438398 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.438827 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.438831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.438834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.439128 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:54.439712 (+ 584us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:54.439889 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 08:47:54.440197 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5528,"thread_start_us":5311,"threads_started":1}
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:47:54.443017 19519 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:54.450587 20340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.419245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:33709 (local address 127.8.149.124:45897)
0808 08:47:54.419487 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:54.419494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:54.428059 (+ 8565us) server_negotiation.cc:407] Connection header received
0808 08:47:54.428268 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:54.428274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:54.428354 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:54.428473 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:54.432731 (+ 4258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.433923 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.436298 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.436999 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.437156 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.441703 (+ 4547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:54.441710 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:54.441714 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:54.441758 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:54.446633 (+ 4875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.448042 (+ 1409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.448049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.448052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.448246 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.448732 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.448738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.448742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.449112 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:54.449248 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:54.449952 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 08:47:54.450201 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260808 08:47:54.450628 20541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.402802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:49679 (local address 127.8.149.125:38801)
0808 08:47:54.415564 (+ 12762us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:54.415574 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:54.418955 (+ 3381us) server_negotiation.cc:407] Connection header received
0808 08:47:54.423567 (+ 4612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:54.423578 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:54.423713 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:54.423841 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:54.427400 (+ 3559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.428714 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.433492 (+ 4778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.434194 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.434313 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.439990 (+ 5677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:54.439998 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:54.440002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:54.440044 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:54.444763 (+ 4719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.447627 (+ 2864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.447634 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.447637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.447799 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.448410 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.448415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.448419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.448795 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:54.448937 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:54.449949 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0808 08:47:54.450199 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12595,"thread_start_us":12385,"threads_started":1}
I20260808 08:47:54.453068 20548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.419338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.8.149.65:33709)
0808 08:47:54.427821 (+ 8483us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:54.427839 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:54.428136 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:54.429313 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:54.429324 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:54.430497 (+ 1173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:54.432478 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.432513 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.434179 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.434185 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.436067 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.436083 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.437558 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.437562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.437678 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.438221 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:54.438246 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:54.441452 (+ 3206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:54.446772 (+ 5320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.446779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.446786 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.447902 (+ 1116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.448409 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.448414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.448417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.448576 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.449331 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:54.449336 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:54.449468 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 08:47:54.450893 (+ 1425us) client_negotiation.cc:240] Negotiation successful
0808 08:47:54.451498 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8362,"mutex_wait_us":57,"spinlock_wait_cycles":1280,"thread_start_us":8870,"threads_started":1}
I20260808 08:47:54.454481 20543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.403912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:55361)
0808 08:47:54.419007 (+ 15095us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:54.419035 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:54.422820 (+ 3785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:54.432704 (+ 9884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:54.432709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:54.433184 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:54.433612 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.433626 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.435291 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.435296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.437061 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.437075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.438796 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.438804 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.439004 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.440016 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:54.440040 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:54.447194 (+ 7154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:54.451343 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.451349 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.451353 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.451914 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.452474 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.452480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.452485 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.452683 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.453368 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:54.453373 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:54.453557 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 08:47:54.453745 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 08:47:54.454019 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13783,"mutex_wait_us":65,"thread_start_us":13472,"threads_started":1}
I20260808 08:47:54.454551 20542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.402802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:55361 (local address 127.8.149.126:41123)
0808 08:47:54.432186 (+ 29384us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:54.432193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:54.432215 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:47:54.432313 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:54.432319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:54.432426 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:54.432687 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:54.433825 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.435093 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.437229 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.438558 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.438672 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.447410 (+ 8738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:54.447416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:54.447421 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:54.447462 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:54.451172 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.452072 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.452079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.452081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.452296 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:54.452825 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:54.452829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:54.452832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:54.453194 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:54.453339 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:54.453882 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 08:47:54.454118 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29205,"thread_start_us":29096,"threads_started":1}
I20260808 08:47:54.453091 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:54.404689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.8.149.65:49679)
0808 08:47:54.418755 (+ 14066us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:54.418814 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:54.423338 (+ 4524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:54.424504 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:54.424520 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:54.425859 (+ 1339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:54.427095 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.427128 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.429002 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.429011 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.433262 (+ 4251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:54.433278 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:54.434746 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:54.434754 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:54.435037 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:54.435753 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:54.435785 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:54.439735 (+ 3950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:54.444976 (+ 5241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.445268 (+ 292us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.445287 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.447468 (+ 2181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.447961 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:54.447967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:54.447972 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:54.448249 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:54.449036 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:54.449044 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:54.449468 (+ 424us) client_negotiation.cc:769] Sending connection context
0808 08:47:54.450893 (+ 1425us) client_negotiation.cc:240] Negotiation successful
0808 08:47:54.451619 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13897,"mutex_wait_us":229,"spinlock_wait_cycles":17792,"thread_start_us":13767,"threads_started":1}
I20260808 08:47:54.455155 20533 heartbeater.cc:347] Connected to a master server at 127.8.149.124:45897
I20260808 08:47:54.455539 20533 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:54.456194 20535 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:54.456315 20535 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:54.456562 20537 heartbeater.cc:347] Connected to a master server at 127.8.149.125:38801
I20260808 08:47:54.456635 20537 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:54.457337 20533 heartbeater.cc:511] Master 127.8.149.124:45897 requested a full tablet report, sending...
I20260808 08:47:54.457365 20537 heartbeater.cc:511] Master 127.8.149.125:38801 requested a full tablet report, sending...
I20260808 08:47:54.457406 20535 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:54.459281 19022 ts_manager.cc:194] Re-registered known tserver with Master: 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:54.459873 19964 ts_manager.cc:194] Registered new tserver with Master: 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:54.459901 20263 ts_manager.cc:194] Registered new tserver with Master: 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:54.460700 19022 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:55361
I20260808 08:47:54.461613 20195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: NON_VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: true } } }
I20260808 08:47:54.461939 20195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:54.464964 20551 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: attempting to promote NON_VOTER 844376a1c37943148b022aef27108cb9 to VOTER
I20260808 08:47:54.465556 20551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } }
I20260808 08:47:54.467378 20278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 LEARNER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:47:54.467555 19982 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Refusing update from remote peer 9959d16b17444ea993f89612790369c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:47:54.468109 20550 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260808 08:47:54.468739 20551 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:47:54.471204 20550 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 844376a1c37943148b022aef27108cb9 (127.8.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.473358 19982 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 844376a1c37943148b022aef27108cb9 (127.8.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.473544 20278 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 844376a1c37943148b022aef27108cb9 (127.8.149.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.475072 20550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.475322 20550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:54.475549 20195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.475765 20195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:54.476011 20195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.476274 20195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:54.478159 20555 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.478587 20555 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:54.482944 20319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9959d16b17444ea993f89612790369c1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:54.483176 20319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:54.538570 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 19329
I20260808 08:47:54.565055 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:45607
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:41123
--webserver_port=32835
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:47:54.897612 20556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:54.897830 20556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:54.897948 20556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:54.904927 20556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:54.905016 20556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:54.905130 20556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:47:54.914309 20556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:45607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=32835
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:54.915635 20556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:54.916880 20556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:54.929745 20568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:54.930004 20567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:54.929997 20571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:54.930905 20556 server_base.cc:1034] running on GCE node
I20260808 08:47:54.931432 20556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:54.932471 20556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:54.933727 20556 hybrid_clock.cc:648] HybridClock initialized: now 1786178874933677 us; error 44 us; skew 500 ppm
I20260808 08:47:54.934022 20556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:54 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:54.937048 20556 init.cc:377] Logged in from keytab as oryx/127.8.149.66@KRBTEST.COM (short username oryx)
I20260808 08:47:54.938485 20556 webserver.cc:460] Webserver started at http://127.8.149.66:32835/ using document root <none> and password file <none>
I20260808 08:47:54.939111 20556 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:54.939272 20556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:54.944242 20556 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:47:54.946723 20585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:54.947995 20556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:47:54.948201 20556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "1112beb54a894960be11010a1c5776cb"
format_stamp: "Formatted at 2026-08-08 08:47:51 on dist-test-slave-7vjv"
server_key: "6fe833b9ca68727537c7bdfc68b2c1b8"
server_key_iv: "ba4f93d68d51a2c0788fb39728f922d7"
server_key_version: "encryptionkey@0"
I20260808 08:47:54.949225 20556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:54.980474 20556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:54.984920 20556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:54.985160 20556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:54.986025 20556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:54.987257 20556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:54.987335 20556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:54.987413 20556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:54.987468 20556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:55.023715 20556 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:45607
I20260808 08:47:55.023805 20748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:45607 every 8 connection(s)
I20260808 08:47:55.025240 20556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:47:55.029294 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 20556
I20260808 08:47:55.029582 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 19535
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178874, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.67@KRBTEST.COM
I20260808 08:47:55.060889 20754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.028601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:38987 (local address 127.8.149.124:45897)
0808 08:47:55.039541 (+ 10940us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.039548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.039581 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:47:55.040173 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.040178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.040254 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.040341 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.043435 (+ 3094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.044450 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.047244 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.047899 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.047983 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.053223 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.053229 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.053233 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.053274 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.056999 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.057873 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.057878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.057883 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.058043 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.058592 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.058598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.058602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.058973 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.059088 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.060202 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.060445 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10800,"thread_start_us":10866,"threads_started":1}
I20260808 08:47:55.062764 20753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.028524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:60629 (local address 127.8.149.126:41123)
0808 08:47:55.028989 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.028995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.030583 (+ 1588us) server_negotiation.cc:407] Connection header received
0808 08:47:55.040088 (+ 9505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.040112 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.040195 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.040305 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.043352 (+ 3047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.044489 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.047221 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.047851 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.047984 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.054575 (+ 6591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.054584 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.054589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.054629 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.058874 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.059943 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.059953 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.059958 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.060183 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.060784 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.060790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.060794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.061246 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.061381 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.062048 (+ 667us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.062303 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":232,"threads_started":1}
I20260808 08:47:55.063149 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.030203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.8.149.66:38987)
0808 08:47:55.030855 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.030872 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.039754 (+ 8882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.040759 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.040766 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.042736 (+ 1970us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.043196 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.043210 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.045373 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.045378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.047082 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.047098 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.048290 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.048296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.048517 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.049383 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.049416 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.052963 (+ 3547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.057152 (+ 4189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.057161 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.057177 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.057750 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.058207 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.058214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.058218 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.058447 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.059199 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.059207 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.059671 (+ 464us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.061373 (+ 1702us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.061873 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":225,"thread_start_us":1073,"threads_started":1}
I20260808 08:47:55.063719 20763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.033170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:46873 (local address 127.8.149.125:38801)
0808 08:47:55.042341 (+ 9171us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.042347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.042385 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:47:55.042446 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.042453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.042568 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.042678 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.044144 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.045192 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.047556 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.048162 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.048303 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.053758 (+ 5455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.053766 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.053771 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.053820 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.058265 (+ 4445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.059178 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.059186 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.059189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.059374 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.059997 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.060005 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.060011 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.060482 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.060650 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.062979 (+ 2329us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.063218 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9038,"thread_start_us":8944,"threads_started":1}
I20260808 08:47:55.064373 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.032696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.8.149.66:46873)
0808 08:47:55.038024 (+ 5328us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.038050 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.040627 (+ 2577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.042872 (+ 2245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.042877 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.043654 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.043943 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.043954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.045343 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.045349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.047388 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.047401 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.048575 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.048584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.048886 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.049653 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.049692 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.053546 (+ 3854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.058467 (+ 4921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.058476 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.058480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.059019 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.059551 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.059557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.059561 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.059819 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.060737 (+ 918us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.060746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.060924 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.061129 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.061724 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5141,"mutex_wait_us":58,"thread_start_us":4963,"threads_started":1}
I20260808 08:47:55.064210 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.029451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:60629)
0808 08:47:55.030424 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.030456 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.039771 (+ 9315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.040652 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.040668 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.041998 (+ 1330us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.043121 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.043159 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.044643 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.044656 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.047056 (+ 2400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.047073 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.048087 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.048120 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.048479 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.049799 (+ 1320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.049821 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.054377 (+ 4556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.059051 (+ 4674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.059059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.059066 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.059737 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.060383 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.060388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.060392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.060594 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.061493 (+ 899us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.061498 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.061673 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.063320 (+ 1647us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.063617 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":114,"thread_start_us":3432,"threads_started":1}
I20260808 08:47:55.065083 20749 heartbeater.cc:347] Connected to a master server at 127.8.149.124:45897
I20260808 08:47:55.065429 20749 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.065817 20759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.031204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.8.149.67:35187)
0808 08:47:55.041330 (+ 10126us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.041335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.041356 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:47:55.041407 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.041412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.041571 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.041737 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.045361 (+ 3624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.046972 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.049796 (+ 2824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.050606 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.050754 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.057939 (+ 7185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.057954 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.057969 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.058020 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.061838 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.062651 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.062659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.062663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.062835 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.063345 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.063349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.063352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.063768 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.064083 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.065183 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.065399 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9973,"thread_start_us":9815,"threads_started":1}
I20260808 08:47:55.065866 20751 heartbeater.cc:347] Connected to a master server at 127.8.149.125:38801
I20260808 08:47:55.066022 20751 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.066558 20749 heartbeater.cc:511] Master 127.8.149.124:45897 requested a full tablet report, sending...
I20260808 08:47:55.066612 20751 heartbeater.cc:511] Master 127.8.149.125:38801 requested a full tablet report, sending...
I20260808 08:47:55.066933 19730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:55.068235 20750 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:55.068396 20750 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.068864 20750 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:55.068982 19964 ts_manager.cc:194] Registered new tserver with Master: 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607)
I20260808 08:47:55.069118 20263 ts_manager.cc:194] Registered new tserver with Master: 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607)
I20260808 08:47:55.070554 19022 ts_manager.cc:194] Re-registered known tserver with Master: 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607)
I20260808 08:47:55.071944 19022 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:60629
I20260808 08:47:55.155457 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 19535
I20260808 08:47:55.180224 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:35187
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:41123
--webserver_port=41575
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:47:55.464046 20535 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
W20260808 08:47:55.523518 20765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:47:55.523820 20765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:47:55.524012 20765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:47:55.531950 20765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:47:55.532063 20765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:47:55.532246 20765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:47:55.541503 20765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:35187
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=41575
--tserver_master_addrs=127.8.149.126:41123,127.8.149.125:38801,127.8.149.124:45897
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:47:55.542734 20765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:47:55.544060 20765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:47:55.556581 20775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:55.556798 20779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:47:55.556800 20783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:47:55.557546 20765 server_base.cc:1034] running on GCE node
I20260808 08:47:55.558171 20765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:47:55.558972 20765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:47:55.560216 20765 hybrid_clock.cc:648] HybridClock initialized: now 1786178875560172 us; error 41 us; skew 500 ppm
I20260808 08:47:55.560506 20765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178875, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:47:55.563560 20765 init.cc:377] Logged in from keytab as oryx/127.8.149.67@KRBTEST.COM (short username oryx)
I20260808 08:47:55.565235 20765 webserver.cc:460] Webserver started at http://127.8.149.67:41575/ using document root <none> and password file <none>
I20260808 08:47:55.565862 20765 fs_manager.cc:359] Metadata directory not provided
I20260808 08:47:55.566026 20765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:47:55.570803 20765 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:47:55.573323 20793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:55.574518 20765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:55.574678 20765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "9f840c779bd0478b9736ac42ef36cd8c"
format_stamp: "Formatted at 2026-08-08 08:47:52 on dist-test-slave-7vjv"
server_key: "8022bbc2768aec655104b9791bf9ead7"
server_key_iv: "d94bfac98a789c53abb61146c4a58125"
server_key_version: "encryptionkey@0"
I20260808 08:47:55.575582 20765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:47:55.587489 20765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:47:55.591296 20765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:47:55.591555 20765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:47:55.592545 20765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:47:55.593911 20765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:47:55.594034 20765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:55.594169 20765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:47:55.594259 20765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:47:55.629411 20765 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:35187
I20260808 08:47:55.629496 20958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:35187 every 8 connection(s)
I20260808 08:47:55.630780 20765 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:47:55.633361 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 20765
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178875, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178875, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.124@KRBTEST.COM
Aug 08 08:47:55 dist-test-slave-7vjv krb5kdc[18950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178875, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.125@KRBTEST.COM
I20260808 08:47:55.672668 20975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.635811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:57215 (local address 127.8.149.126:41123)
0808 08:47:55.648517 (+ 12706us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.648523 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.648546 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:55.651367 (+ 2821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.651377 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.651489 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.651591 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.654665 (+ 3074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.656143 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.658823 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.659432 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.659532 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.664747 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.664753 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.664757 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.664796 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.668984 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.669839 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.669846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.669851 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.670041 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.670574 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.670580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.670582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.670969 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.671094 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.672040 (+ 946us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.672299 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12585,"thread_start_us":12477,"threads_started":1}
I20260808 08:47:55.672905 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.648907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:58197 (local address 127.8.149.124:45897)
0808 08:47:55.652485 (+ 3578us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.652493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.656604 (+ 4111us) server_negotiation.cc:407] Connection header received
0808 08:47:55.656785 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.656792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.656871 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.656975 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.658290 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.659494 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.661312 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.661990 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.662083 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.666447 (+ 4364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.666454 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.666460 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.666501 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.669929 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.670737 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.670743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.670746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.670874 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.671330 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.671335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.671337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.671698 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.671842 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.672341 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.672571 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3455,"thread_start_us":3311,"threads_started":1}
I20260808 08:47:55.675298 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.648879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.8.149.67:58197)
0808 08:47:55.656459 (+ 7580us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.656497 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.656652 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.657160 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.657165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.657780 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.658121 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.658133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.659676 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.659683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.661132 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.661145 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.662419 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.662429 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.662631 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.663154 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.663170 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.666202 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.670075 (+ 3873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.670084 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.670088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.670612 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.671020 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.671028 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.671032 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.671214 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.671923 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.671927 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.672056 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.673349 (+ 1293us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.673571 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7451,"thread_start_us":7145,"threads_started":1}
I20260808 08:47:55.675321 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.634386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:57215)
0808 08:47:55.644840 (+ 10454us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.644909 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.648085 (+ 3176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.652270 (+ 4185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.652285 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.653323 (+ 1038us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.654405 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.654436 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.656364 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.656367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.658665 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.658678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.659901 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.659908 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.660205 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.661079 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.661118 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.664512 (+ 3394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.669144 (+ 4632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.669152 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.669167 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.669698 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.670184 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.670191 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.670196 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.670436 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.671184 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.671192 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.671607 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.672974 (+ 1367us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.673472 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10065,"thread_start_us":9783,"threads_started":1}
I20260808 08:47:55.676400 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.633682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:33071 (local address 127.8.149.125:38801)
0808 08:47:55.650808 (+ 17126us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.650817 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.650845 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:47:55.652632 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.652642 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.652816 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.652959 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.655135 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.656420 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.659251 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.660073 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.660257 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.667857 (+ 7600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.667865 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.667871 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.667918 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.672161 (+ 4243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.673524 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.673533 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.673539 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.673728 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.674248 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.674258 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.674263 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.674774 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.674956 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.675733 (+ 777us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.675971 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16956,"thread_start_us":17180,"threads_started":1}
I20260808 08:47:55.676580 20967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.634945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.8.149.67:33071)
0808 08:47:55.648611 (+ 13666us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.648645 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.652418 (+ 3773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.653199 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.653208 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.654257 (+ 1049us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:47:55.654872 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.654893 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.656703 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.656710 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.659020 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.659041 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.661130 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.661142 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.661450 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.662319 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:47:55.662369 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:47:55.667617 (+ 5248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:47:55.672388 (+ 4771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.672396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.672402 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.673344 (+ 942us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.673897 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:47:55.673903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:47:55.673906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:47:55.674072 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:47:55.675092 (+ 1020us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:47:55.675100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:47:55.675340 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.675606 (+ 266us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.675984 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13493,"thread_start_us":13303,"threads_started":1}
I20260808 08:47:55.677744 20959 heartbeater.cc:347] Connected to a master server at 127.8.149.124:45897
I20260808 08:47:55.684229 20959 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.685114 20959 heartbeater.cc:511] Master 127.8.149.124:45897 requested a full tablet report, sending...
I20260808 08:47:55.678144 20960 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41123
I20260808 08:47:55.686116 20960 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.686638 20960 heartbeater.cc:511] Master 127.8.149.126:41123 requested a full tablet report, sending...
I20260808 08:47:55.688048 19022 ts_manager.cc:194] Re-registered known tserver with Master: 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187)
I20260808 08:47:55.688452 20263 ts_manager.cc:194] Registered new tserver with Master: 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187)
I20260808 08:47:55.689730 19022 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:57215
I20260808 08:47:55.689915 20961 heartbeater.cc:347] Connected to a master server at 127.8.149.125:38801
I20260808 08:47:55.690038 20961 heartbeater.cc:464] Registering TS with master...
I20260808 08:47:55.690526 20961 heartbeater.cc:511] Master 127.8.149.125:38801 requested a full tablet report, sending...
I20260808 08:47:55.692241 19964 ts_manager.cc:194] Registered new tserver with Master: 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187)
I20260808 08:47:55.708441 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.677350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45674 (local address 127.8.149.125:38801)
0808 08:47:55.680407 (+ 3057us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.680413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.690402 (+ 9989us) server_negotiation.cc:407] Connection header received
0808 08:47:55.691382 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.691388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.691499 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.691584 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.694801 (+ 3217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.695772 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.697806 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.698630 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.698811 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.702235 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.702242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.702248 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.702285 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.705690 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.706421 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.706427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.706430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.706566 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.707030 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.707035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.707038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.707288 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.707545 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.707880 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.708084 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2932,"thread_start_us":13343,"threads_started":1}
I20260808 08:47:55.710981 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.690883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39170 (local address 127.8.149.124:45897)
0808 08:47:55.691060 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.691065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.693830 (+ 2765us) server_negotiation.cc:407] Connection header received
0808 08:47:55.694019 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.694025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.694119 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.694220 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.696799 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.697850 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.699752 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.700292 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.700453 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.703713 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.703722 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.703728 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.703772 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.707966 (+ 4194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.708894 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.708902 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.708909 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.709080 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.709585 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.709590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.709592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.709956 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.710209 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.710521 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.710730 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:47:55.713222 20975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.668588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59064 (local address 127.8.149.126:41123)
0808 08:47:55.672904 (+ 4316us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.672909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.674236 (+ 1327us) server_negotiation.cc:407] Connection header received
0808 08:47:55.674450 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.674455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.674549 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.674632 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:55.680010 (+ 5378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.681400 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.693666 (+ 12266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.694571 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.694747 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.698673 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:55.698680 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:55.698687 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:55.698729 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:55.702518 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.703793 (+ 1275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.703800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.703805 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.703954 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:55.704915 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:55.704920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:55.704923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:55.705294 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:55.705564 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.712625 (+ 7061us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.712845 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4207,"thread_start_us":22361,"threads_started":1}
I20260808 08:47:55.718096 19022 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:55.725630 19022 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:55.764880 21013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.746339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35187 (local address 127.0.0.1:50218)
0808 08:47:55.749769 (+ 3430us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.749790 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.750140 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.753706 (+ 3566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.753714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.753751 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:55.754397 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.754413 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.758396 (+ 3983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.758402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.761661 (+ 3259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.761682 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.764186 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.764191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.764302 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.764324 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.764422 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.764543 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3295,"thread_start_us":9317,"threads_started":1}
I20260808 08:47:55.764952 21011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.746688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50218 (local address 127.8.149.67:35187)
0808 08:47:55.747718 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.747732 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.749990 (+ 2258us) server_negotiation.cc:407] Connection header received
0808 08:47:55.750365 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.750378 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.750716 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.751031 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:55.754760 (+ 3729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.756836 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.762437 (+ 5601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.763782 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.763856 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.763995 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.764494 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.764643 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":539,"threads_started":1}
I20260808 08:47:55.767938 21010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.747855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34231 (local address 127.0.0.1:36044)
0808 08:47:55.755904 (+ 8049us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.755921 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.756154 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.757324 (+ 1170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.757333 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.757372 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:55.757986 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.758003 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.761022 (+ 3019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.761030 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.764080 (+ 3050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.764125 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.767134 (+ 3009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.767140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.767324 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.767360 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.767478 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.767602 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7932,"thread_start_us":1914,"threads_started":1}
I20260808 08:47:55.768006 21014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.748443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36044 (local address 127.8.149.65:34231)
0808 08:47:55.755193 (+ 6750us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.755207 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.756152 (+ 945us) server_negotiation.cc:407] Connection header received
0808 08:47:55.756306 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.756335 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.756656 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.757008 (+ 352us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:55.758264 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.760783 (+ 2519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.764372 (+ 3589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.766887 (+ 2515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.767078 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.767296 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.767523 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.767680 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":328,"threads_started":1}
I20260808 08:47:55.769356 20862 tablet_service.cc:1467] Processing CreateTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 (DEFAULT_TABLE table=test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:55.770720 20862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39106fff8aa1459ab47a2bf2149d7553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:55.771206 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 (DEFAULT_TABLE table=test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:55.772701 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39106fff8aa1459ab47a2bf2149d7553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:55.773144 21013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.749344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45607 (local address 127.0.0.1:35658)
0808 08:47:55.765355 (+ 16011us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.765407 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.765528 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.766717 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.766721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.766745 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:55.766892 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.766902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.768600 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.768603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.770126 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.770150 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.772323 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.772332 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.772548 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.772582 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.772683 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.772828 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15942,"thread_start_us":17130,"threads_started":1}
I20260808 08:47:55.773957 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.749637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.8.149.66:45607)
0808 08:47:55.765252 (+ 15615us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.765258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.765495 (+ 237us) server_negotiation.cc:407] Connection header received
0808 08:47:55.765743 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.765753 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.765958 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.766199 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:55.767073 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.768454 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.770311 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.771762 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.771947 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.772210 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.773442 (+ 1232us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.773609 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12475,"thread_start_us":12386,"threads_started":1}
I20260808 08:47:55.778975 20654 tablet_service.cc:1467] Processing CreateTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 (DEFAULT_TABLE table=test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:55.780460 20654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39106fff8aa1459ab47a2bf2149d7553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:55.784915 21020 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Bootstrap starting.
I20260808 08:47:55.788803 21020 tablet_bootstrap.cc:654] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:55.790447 21020 log.cc:824] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:55.793309 21022 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Bootstrap starting.
I20260808 08:47:55.798588 21024 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Bootstrap starting.
I20260808 08:47:55.799333 21020 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: No bootstrap required, opened a new log
I20260808 08:47:55.799692 21020 ts_tablet_manager.cc:1397] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260808 08:47:55.799782 21022 tablet_bootstrap.cc:654] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:55.802160 21022 log.cc:824] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:55.803738 21024 tablet_bootstrap.cc:654] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:55.805648 21024 log.cc:824] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:47:55.806453 21022 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: No bootstrap required, opened a new log
I20260808 08:47:55.806921 21022 ts_tablet_manager.cc:1397] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20260808 08:47:55.809454 21024 tablet_bootstrap.cc:492] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: No bootstrap required, opened a new log
I20260808 08:47:55.809885 21024 ts_tablet_manager.cc:1397] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20260808 08:47:55.812355 21020 raft_consensus.cc:348] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.812963 21020 raft_consensus.cc:374] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:55.813170 21020 raft_consensus.cc:729] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 207354ebcfae4f84863ac0244cac8265, State: Initialized, Role: FOLLOWER
I20260808 08:47:55.813882 21020 consensus_queue.cc:260] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.816422 21020 ts_tablet_manager.cc:1428] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Time spent starting tablet: real 0.017s user 0.008s sys 0.008s
I20260808 08:47:55.821905 21024 raft_consensus.cc:348] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.822335 21024 raft_consensus.cc:374] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:55.822512 21024 raft_consensus.cc:729] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1112beb54a894960be11010a1c5776cb, State: Initialized, Role: FOLLOWER
I20260808 08:47:55.823293 21024 consensus_queue.cc:260] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.823560 21022 raft_consensus.cc:348] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.824031 21022 raft_consensus.cc:374] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:55.824198 21022 raft_consensus.cc:729] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f840c779bd0478b9736ac42ef36cd8c, State: Initialized, Role: FOLLOWER
I20260808 08:47:55.824856 21022 consensus_queue.cc:260] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.825098 21024 ts_tablet_manager.cc:1428] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260808 08:47:55.825521 20750 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
I20260808 08:47:55.827140 21022 ts_tablet_manager.cc:1428] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Time spent starting tablet: real 0.020s user 0.015s sys 0.000s
I20260808 08:47:55.827517 20960 heartbeater.cc:503] Master 127.8.149.126:41123 was elected leader, sending a full tablet report...
W20260808 08:47:55.889339 20962 tablet.cc:2369] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:47:55.909704 20539 tablet.cc:2369] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:55.959967 21028 raft_consensus.cc:482] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:55.960347 21028 raft_consensus.cc:504] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.961939 21028 leader_election.cc:288] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187), 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:55.970451 21011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.962520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:46733 (local address 127.8.149.67:35187)
0808 08:47:55.962717 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.962724 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.963608 (+ 884us) server_negotiation.cc:407] Connection header received
0808 08:47:55.963779 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.963784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.963856 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.963949 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:55.964790 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.965842 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.968705 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.969484 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.969613 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.969667 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.970058 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.970185 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:47:55.970536 21035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.962263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35187 (local address 127.8.149.66:46733)
0808 08:47:55.963301 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.963367 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.963637 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.964008 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.964012 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.964054 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:55.964580 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.964593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.966002 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.966007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.968533 (+ 2526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.968550 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.969664 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.969668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.969779 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.969815 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.969968 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.970134 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":184,"spinlock_wait_cycles":8448,"thread_start_us":655,"threads_started":1}
I20260808 08:47:55.971647 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.962211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34231 (local address 127.8.149.66:49597)
0808 08:47:55.963248 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:55.963278 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:55.963588 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:55.964008 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:55.964012 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:55.964048 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:55.964580 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.964593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.966002 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.966007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.968542 (+ 2535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:55.968550 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.970928 (+ 2378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.970939 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:55.971111 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.971148 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:47:55.971250 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:47:55.971330 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":172,"spinlock_wait_cycles":1408,"thread_start_us":627,"threads_started":1}
I20260808 08:47:55.971714 21014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:55.962419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:49597 (local address 127.8.149.65:34231)
0808 08:47:55.962639 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:55.962645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:55.963468 (+ 823us) server_negotiation.cc:407] Connection header received
0808 08:47:55.963778 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:55.963783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:55.963856 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:55.963977 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:55.964792 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.965841 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.969737 (+ 3896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:55.970625 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:55.970818 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:55.970921 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:55.971307 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 08:47:55.971469 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:47:55.971791 20896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39106fff8aa1459ab47a2bf2149d7553" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f840c779bd0478b9736ac42ef36cd8c" is_pre_election: true
I20260808 08:47:55.972544 20896 raft_consensus.cc:2454] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 0.
I20260808 08:47:55.972872 20462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39106fff8aa1459ab47a2bf2149d7553" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207354ebcfae4f84863ac0244cac8265" is_pre_election: true
I20260808 08:47:55.973443 20588 leader_election.cc:302] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112beb54a894960be11010a1c5776cb, 9f840c779bd0478b9736ac42ef36cd8c; no voters:
I20260808 08:47:55.973654 20462 raft_consensus.cc:2454] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 0.
I20260808 08:47:55.973869 21028 raft_consensus.cc:2781] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:55.974035 21028 raft_consensus.cc:482] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:55.974138 21028 raft_consensus.cc:3037] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:55.976526 21028 raft_consensus.cc:504] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.977108 21028 leader_election.cc:288] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 election: Requested vote from peers 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187), 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:55.977519 20896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39106fff8aa1459ab47a2bf2149d7553" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f840c779bd0478b9736ac42ef36cd8c"
I20260808 08:47:55.977667 20462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39106fff8aa1459ab47a2bf2149d7553" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207354ebcfae4f84863ac0244cac8265"
I20260808 08:47:55.977720 20896 raft_consensus.cc:3037] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:55.977962 20462 raft_consensus.cc:3037] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:55.981228 20896 raft_consensus.cc:2454] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 1.
I20260808 08:47:55.981268 20462 raft_consensus.cc:2454] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 1.
I20260808 08:47:55.981684 20586 leader_election.cc:302] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112beb54a894960be11010a1c5776cb, 207354ebcfae4f84863ac0244cac8265; no voters:
I20260808 08:47:55.982102 21028 raft_consensus.cc:2781] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:55.982704 21028 raft_consensus.cc:686] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 1 LEADER]: Becoming Leader. State: Replica: 1112beb54a894960be11010a1c5776cb, State: Running, Role: LEADER
I20260808 08:47:55.983270 21028 consensus_queue.cc:237] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } }
I20260808 08:47:55.988878 19021 catalog_manager.cc:5495] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1112beb54a894960be11010a1c5776cb (127.8.149.66). New cstate: current_term: 1 leader_uuid: "1112beb54a894960be11010a1c5776cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } health_report { overall_health: HEALTHY } } }
W20260808 08:47:56.030933 20752 tablet.cc:2369] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:47:56.056033 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:56.049877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35674 (local address 127.8.149.66:45607)
0808 08:47:56.050097 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:56.050104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:56.050127 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:47:56.050328 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:56.050343 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:56.050438 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:56.050614 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:56.051093 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.051888 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.053497 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.054006 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.054169 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:56.054729 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:56.055318 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:56.055532 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:56.055598 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 08:47:56.055695 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:47:56.064232 20896 raft_consensus.cc:1261] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Refusing update from remote peer 1112beb54a894960be11010a1c5776cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:56.064479 20462 raft_consensus.cc:1261] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Refusing update from remote peer 1112beb54a894960be11010a1c5776cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:56.065243 21037 consensus_queue.cc:1035] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:56.065662 21028 consensus_queue.cc:1035] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:56.099707 19021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:56.100080 19021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:56.107585 19021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9959d16b17444ea993f89612790369c1: Sending DeleteTablet for 3 replicas of tablet 39106fff8aa1459ab47a2bf2149d7553
I20260808 08:47:56.108860 20862 tablet_service.cc:1514] Processing DeleteTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:56 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:50218
I20260808 08:47:56.108923 20654 tablet_service.cc:1514] Processing DeleteTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:56 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:35658
I20260808 08:47:56.109930 21058 tablet_replica.cc:330] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: stopping tablet replica
I20260808 08:47:56.110209 20430 tablet_service.cc:1514] Processing DeleteTablet for tablet 39106fff8aa1459ab47a2bf2149d7553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:56 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:36044
I20260808 08:47:56.111655 21058 raft_consensus.cc:2229] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:56.112622 21058 raft_consensus.cc:2258] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:56.114646 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 18973
I20260808 08:47:56.116175 19075 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:56.122620 21058 ts_tablet_manager.cc:1905] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:56.133814 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:56.111027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45678 (local address 127.8.149.125:38801)
0808 08:47:56.111225 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:56.111233 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:56.114607 (+ 3374us) server_negotiation.cc:407] Connection header received
0808 08:47:56.115109 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:56.115119 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:56.115247 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:56.115339 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:56.118299 (+ 2960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.119474 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.121484 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.122168 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.122267 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:56.126236 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:56.126243 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:56.126248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:56.126294 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:56.130400 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.131272 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.131278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.131283 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.131447 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.131975 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.131980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.131983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.132361 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:56.132611 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:56.133206 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 08:47:56.133435 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:47:56.137884 21062 tablet_replica.cc:330] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: stopping tablet replica
I20260808 08:47:56.138398 21062 raft_consensus.cc:2229] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:56.139030 21062 raft_consensus.cc:2258] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:56.141660 21059 tablet_replica.cc:330] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: stopping tablet replica
I20260808 08:47:56.142138 21059 raft_consensus.cc:2229] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:56.143209 21062 ts_tablet_manager.cc:1905] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:56.143347 21058 ts_tablet_manager.cc:1918] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:56.143800 21058 log.cc:1196] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/39106fff8aa1459ab47a2bf2149d7553
I20260808 08:47:56.145040 21058 ts_tablet_manager.cc:1939] T 39106fff8aa1459ab47a2bf2149d7553 P 1112beb54a894960be11010a1c5776cb: Deleting consensus metadata
I20260808 08:47:56.146096 21059 raft_consensus.cc:2258] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:56.148571 21059 ts_tablet_manager.cc:1905] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:56.157137 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:56.114057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.8.149.124:45897)
0808 08:47:56.114259 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:56.114268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:56.135121 (+ 20853us) server_negotiation.cc:407] Connection header received
0808 08:47:56.135276 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:56.135282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:56.135375 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:56.135495 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:56.137573 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.138898 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.140917 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.141798 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.141966 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:56.145837 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:56.145844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:56.145849 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:56.145912 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:56.149427 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.153008 (+ 3581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.153015 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.153020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.153381 (+ 361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.154130 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.154137 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.154142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.154790 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:56.155261 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:56.156218 (+ 957us) server_negotiation.cc:299] Negotiation successful
0808 08:47:56.156488 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:47:56.157302 21059 ts_tablet_manager.cc:1918] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:56.157626 21059 log.cc:1196] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/39106fff8aa1459ab47a2bf2149d7553
I20260808 08:47:56.158499 21059 ts_tablet_manager.cc:1939] T 39106fff8aa1459ab47a2bf2149d7553 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting consensus metadata
I20260808 08:47:56.160214 21062 ts_tablet_manager.cc:1918] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:56.161594 21062 log.cc:1196] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/39106fff8aa1459ab47a2bf2149d7553
I20260808 08:47:56.162488 21062 ts_tablet_manager.cc:1939] T 39106fff8aa1459ab47a2bf2149d7553 P 207354ebcfae4f84863ac0244cac8265: Deleting consensus metadata
I20260808 08:47:56.275717 19000 catalog_manager.cc:4841] TS 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231): tablet 39106fff8aa1459ab47a2bf2149d7553 (table test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]) successfully deleted
I20260808 08:47:56.276892 19001 catalog_manager.cc:4841] TS 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607): tablet 39106fff8aa1459ab47a2bf2149d7553 (table test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]) successfully deleted
I20260808 08:47:56.277282 19002 catalog_manager.cc:4841] TS 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187): tablet 39106fff8aa1459ab47a2bf2149d7553 (table test-table [id=7b98187556a84cb1bc1d03d4ac8e8f27]) successfully deleted
I20260808 08:47:56.277911 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 18973
I20260808 08:47:56.345005 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:56.325037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45688 (local address 127.8.149.125:38801)
0808 08:47:56.325231 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:56.325237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:56.326297 (+ 1060us) server_negotiation.cc:407] Connection header received
0808 08:47:56.326583 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:56.326591 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:56.326678 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:56.326751 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:56.329183 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.330256 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.332297 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.333037 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.333153 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:56.337848 (+ 4695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:56.337854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:56.337859 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:56.337897 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:56.341613 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.342584 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.342589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.342593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.342739 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.343208 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.343213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.343217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.343579 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:56.343803 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:56.344434 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 08:47:56.344653 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:47:56.345323 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:56.326449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.8.149.124:45897)
0808 08:47:56.326650 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:56.326656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:56.327221 (+ 565us) server_negotiation.cc:407] Connection header received
0808 08:47:56.327306 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:56.327314 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:56.327410 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:56.327507 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:56.329332 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.330491 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.332303 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:56.332853 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:56.332929 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:56.337279 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:56.337286 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:56.337292 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:56.337330 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:56.341838 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.343124 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.343130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.343132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.343360 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:56.343757 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:56.343762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:56.343765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:56.344036 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:56.344634 (+ 598us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:56.344760 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 08:47:56.344967 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:47:57.085170 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.084147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:39281)
0808 08:47:57.084765 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.084935 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":311,"threads_started":1}
W20260808 08:47:57.085892 20535 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:41123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.090583 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.089671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:45531)
0808 08:47:57.090229 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.090353 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":253,"threads_started":1}
W20260808 08:47:57.091084 20960 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:41123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.094643 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.094058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:39285)
0808 08:47:57.094415 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.094508 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":189,"threads_started":1}
W20260808 08:47:57.095036 20750 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:41123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.607623 21084 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9959d16b17444ea993f89612790369c1)
I20260808 08:47:57.607784 21085 raft_consensus.cc:482] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9959d16b17444ea993f89612790369c1)
I20260808 08:47:57.607959 21085 raft_consensus.cc:504] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } }
I20260808 08:47:57.607936 21084 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } }
I20260808 08:47:57.608927 21085 leader_election.cc:288] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123), f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125:38801)
I20260808 08:47:57.609573 21084 leader_election.cc:288] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123), 844376a1c37943148b022aef27108cb9 (127.8.149.124:45897)
I20260808 08:47:57.610687 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.609098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59490)
0808 08:47:57.610178 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.610390 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":917,"threads_started":1}
I20260808 08:47:57.611486 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.609645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59500)
0808 08:47:57.610872 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.611127 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1114,"thread_start_us":1014,"threads_started":1}
W20260808 08:47:57.611922 19943 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
W20260808 08:47:57.620826 20234 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.621307 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.609388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45696 (local address 127.8.149.125:38801)
0808 08:47:57.610506 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:57.610515 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:57.611158 (+ 643us) server_negotiation.cc:407] Connection header received
0808 08:47:57.611467 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:57.611475 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:57.611580 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:57.611666 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:57.612717 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.614562 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.618081 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.619883 (+ 1802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.620048 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.620174 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:57.620778 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 08:47:57.620930 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":944,"thread_start_us":756,"threads_started":1}
I20260808 08:47:57.621907 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.621130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59512)
0808 08:47:57.621398 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.621619 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:47:57.622148 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.609202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:38801 (local address 127.0.0.1:45696)
0808 08:47:57.611044 (+ 1842us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.611066 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:57.611281 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:57.612038 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:57.612045 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:57.612079 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:57.612493 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.612507 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.614809 (+ 2302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.614817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.617822 (+ 3005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.617845 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.620312 (+ 2467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.620319 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.620550 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.620584 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:47:57.621563 (+ 979us) client_negotiation.cc:240] Negotiation successful
0808 08:47:57.621729 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1699,"thread_start_us":650,"threads_started":1}
W20260808 08:47:57.622182 19943 leader_election.cc:334] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123): Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.622848 19982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "844376a1c37943148b022aef27108cb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f5c819b4b508438fbdda67d3ef352db0" is_pre_election: true
I20260808 08:47:57.623113 19982 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 844376a1c37943148b022aef27108cb9 in term 1.
I20260808 08:47:57.623586 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.623165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59516)
0808 08:47:57.623328 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.623424 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:47:57.623651 20233 leader_election.cc:302] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 844376a1c37943148b022aef27108cb9, f5c819b4b508438fbdda67d3ef352db0; no voters:
W20260808 08:47:57.623867 20234 leader_election.cc:334] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123): Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.623970 21085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 08:47:57.624142 21085 raft_consensus.cc:482] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9959d16b17444ea993f89612790369c1)
I20260808 08:47:57.624251 21085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:47:57.627031 21085 raft_consensus.cc:504] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } }
I20260808 08:47:57.627564 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.610488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:45897 (local address 127.0.0.1:39198)
0808 08:47:57.617057 (+ 6569us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.617080 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:57.617227 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:57.621199 (+ 3972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:57.621204 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:57.621229 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:57.621566 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.621579 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.623179 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.623184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.625288 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.625304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.626768 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.626776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.626974 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.627012 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:47:57.627161 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 08:47:57.627332 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6441,"thread_start_us":9595,"threads_started":1}
I20260808 08:47:57.627877 21085 leader_election.cc:288] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 election: Requested vote from peers 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123), f5c819b4b508438fbdda67d3ef352db0 (127.8.149.125:38801)
I20260808 08:47:57.628038 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.616117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39198 (local address 127.8.149.124:45897)
0808 08:47:57.620644 (+ 4527us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:57.620651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:57.620670 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:57.620765 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:57.620770 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:57.620839 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:57.620926 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:57.621761 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.623045 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.625524 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.626571 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.626691 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.626769 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:57.627218 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 08:47:57.627436 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4414,"thread_start_us":4502,"threads_started":1}
I20260808 08:47:57.628281 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.627941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59526)
0808 08:47:57.628089 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.628179 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 08:47:57.628407 19982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "844376a1c37943148b022aef27108cb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f5c819b4b508438fbdda67d3ef352db0"
I20260808 08:47:57.628652 19982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:47:57.629112 20278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5c819b4b508438fbdda67d3ef352db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "844376a1c37943148b022aef27108cb9" is_pre_election: true
I20260808 08:47:57.629527 20278 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c819b4b508438fbdda67d3ef352db0 in current term 2: Already voted for candidate 844376a1c37943148b022aef27108cb9 in this term.
I20260808 08:47:57.630754 19942 leader_election.cc:302] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c819b4b508438fbdda67d3ef352db0; no voters: 844376a1c37943148b022aef27108cb9, 9959d16b17444ea993f89612790369c1
I20260808 08:47:57.631687 19982 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 844376a1c37943148b022aef27108cb9 in term 2.
I20260808 08:47:57.631891 21084 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:47:57.632170 20233 leader_election.cc:302] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 844376a1c37943148b022aef27108cb9, f5c819b4b508438fbdda67d3ef352db0; no voters:
I20260808 08:47:57.632498 21085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:47:57.632551 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.629205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59528)
0808 08:47:57.632257 (+ 3052us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.632332 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2935}
W20260808 08:47:57.632844 20234 leader_election.cc:334] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123): Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
I20260808 08:47:57.633080 21085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [term 2 LEADER]: Becoming Leader. State: Replica: 844376a1c37943148b022aef27108cb9, State: Running, Role: LEADER
I20260808 08:47:57.633471 21085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } }
I20260808 08:47:57.635334 21098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 844376a1c37943148b022aef27108cb9. Latest consensus state: current_term: 2 leader_uuid: "844376a1c37943148b022aef27108cb9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:57.635679 21098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:57.636417 21100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:47:57.640051 21100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:47:57.640885 21100 catalog_manager.cc:1259] Loaded cluster ID: d4e260686e7a45dc9036d19dee59779e
I20260808 08:47:57.640990 21100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:47:57.642190 21100 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:47:57.643023 21100 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Loaded TSK: 0
I20260808 08:47:57.643880 21100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:47:57.668442 20263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:47:57.675254 20263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:47:57.679337 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.678955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59538)
0808 08:47:57.679130 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.679202 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:47:57.679397 19982 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [term 2 FOLLOWER]: Refusing update from remote peer 844376a1c37943148b022aef27108cb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 08:47:57.680272 21098 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 08:47:57.680411 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.680028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59550)
0808 08:47:57.680211 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.680300 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260808 08:47:57.680699 20234 consensus_peers.cc:487] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 -> Peer 9959d16b17444ea993f89612790369c1 (127.8.149.126:41123): Couldn't send request to peer 9959d16b17444ea993f89612790369c1. Status: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 08:47:57.683732 21084 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 844376a1c37943148b022aef27108cb9. Latest consensus state: current_term: 2 leader_uuid: "844376a1c37943148b022aef27108cb9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:57.684047 21084 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:57.684614 21101 mvcc.cc:205] Tried to move back new op lower bound from 7316188682968174592 to 7316188682790330368. Current Snapshot: MvccSnapshot[applied={T|T < 7316188682968174592}]
I20260808 08:47:57.685141 21085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "844376a1c37943148b022aef27108cb9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:57.685556 21085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:47:57.685804 21084 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "844376a1c37943148b022aef27108cb9" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "9959d16b17444ea993f89612790369c1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41123 } } peers { permanent_uuid: "f5c819b4b508438fbdda67d3ef352db0" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 38801 } attrs { promote: false } } peers { permanent_uuid: "844376a1c37943148b022aef27108cb9" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 45897 } attrs { promote: false } } }
I20260808 08:47:57.686105 21084 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c819b4b508438fbdda67d3ef352db0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:47:57.703248 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.694959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34231 (local address 127.0.0.1:36048)
0808 08:47:57.695180 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.695197 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:57.695282 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:57.696587 (+ 1305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:57.696592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:57.696618 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:57.697133 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.697146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.698915 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.698921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.701200 (+ 2279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.701213 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.702492 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.702498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.702692 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.702781 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 08:47:57.702876 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:47:57.702982 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":29}
I20260808 08:47:57.703548 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.694136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:35187 (local address 127.0.0.1:50234)
0808 08:47:57.694273 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.694292 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:57.694387 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:57.695131 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:57.695136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:57.695167 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:57.695364 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.695380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.698021 (+ 2641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.698027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.700745 (+ 2718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.700759 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.702623 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.702630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.702891 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.702929 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:47:57.702996 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 08:47:57.703153 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":607}
I20260808 08:47:57.704057 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.694278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.8.149.67:35187)
0808 08:47:57.694747 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:57.694755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:57.694774 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:57.694850 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:57.694858 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:57.694960 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:57.695502 (+ 542us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:57.696390 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.697863 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.700944 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.702438 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.703354 (+ 916us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.703531 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:57.703590 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 08:47:57.703730 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":258,"threads_started":1}
I20260808 08:47:57.704327 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.695150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36048 (local address 127.8.149.65:34231)
0808 08:47:57.696211 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:57.696219 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:57.696240 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:47:57.696318 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:57.696323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:57.696413 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:57.697339 (+ 926us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:57.697586 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.698784 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.701355 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.702253 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.702420 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.702542 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:57.703810 (+ 1268us) server_negotiation.cc:299] Negotiation successful
0808 08:47:57.703966 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885,"thread_start_us":768,"threads_started":1}
I20260808 08:47:57.704875 20862 tablet_service.cc:1467] Processing CreateTablet for tablet 8f615644b240494489a6aab0d40579c6 (DEFAULT_TABLE table=test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:57.705071 20430 tablet_service.cc:1467] Processing CreateTablet for tablet 8f615644b240494489a6aab0d40579c6 (DEFAULT_TABLE table=test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:57.705407 20862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f615644b240494489a6aab0d40579c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:57.705541 20430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f615644b240494489a6aab0d40579c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:57.706866 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.695215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:45607 (local address 127.0.0.1:35690)
0808 08:47:57.695851 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.695868 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:47:57.695973 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:47:57.698686 (+ 2713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:47:57.698694 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:47:57.698716 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:47:57.699261 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.699273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.700814 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.700820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.703231 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:47:57.703249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.706086 (+ 2837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.706091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:47:57.706262 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.706297 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:47:57.706392 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:47:57.706508 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":3,"thread_start_us":335,"threads_started":1}
I20260808 08:47:57.706923 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.695874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35690 (local address 127.8.149.66:45607)
0808 08:47:57.698343 (+ 2469us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:57.698347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:57.698362 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:47:57.698445 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:57.698452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:57.698548 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:57.698662 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:47:57.699456 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.700628 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.703412 (+ 2784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:57.705841 (+ 2429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:57.706031 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:57.706127 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:57.706438 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 08:47:57.706593 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2363,"thread_start_us":2255,"threads_started":1}
I20260808 08:47:57.707955 20654 tablet_service.cc:1467] Processing CreateTablet for tablet 8f615644b240494489a6aab0d40579c6 (DEFAULT_TABLE table=test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:47:57.708443 20654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f615644b240494489a6aab0d40579c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:47:57.711668 21121 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Bootstrap starting.
I20260808 08:47:57.713209 21121 tablet_bootstrap.cc:654] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:57.715378 21121 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: No bootstrap required, opened a new log
I20260808 08:47:57.715521 21121 ts_tablet_manager.cc:1397] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:47:57.716199 21121 raft_consensus.cc:348] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.716425 21121 raft_consensus.cc:374] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:57.716533 21121 raft_consensus.cc:729] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 207354ebcfae4f84863ac0244cac8265, State: Initialized, Role: FOLLOWER
I20260808 08:47:57.716794 21121 consensus_queue.cc:260] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.717612 21121 ts_tablet_manager.cc:1428] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 08:47:57.722525 20533 heartbeater.cc:503] Master 127.8.149.124:45897 was elected leader, sending a full tablet report...
I20260808 08:47:57.725041 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.717839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:42001)
0808 08:47:57.724706 (+ 6867us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.724854 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6746,"thread_start_us":6567,"threads_started":1}
I20260808 08:47:57.725989 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.725657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:37705)
0808 08:47:57.725797 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.725890 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 08:47:57.728603 21128 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Bootstrap starting.
I20260808 08:47:57.730182 21128 tablet_bootstrap.cc:654] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:57.731446 21122 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Bootstrap starting.
I20260808 08:47:57.733022 21122 tablet_bootstrap.cc:654] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Neither blocks nor log segments found. Creating new log.
I20260808 08:47:57.733402 21128 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: No bootstrap required, opened a new log
I20260808 08:47:57.733564 21128 ts_tablet_manager.cc:1397] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:47:57.734386 21128 raft_consensus.cc:348] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.734623 21128 raft_consensus.cc:374] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:57.734730 21128 raft_consensus.cc:729] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1112beb54a894960be11010a1c5776cb, State: Initialized, Role: FOLLOWER
I20260808 08:47:57.735004 21128 consensus_queue.cc:260] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.735225 21122 tablet_bootstrap.cc:492] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: No bootstrap required, opened a new log
I20260808 08:47:57.735571 21122 ts_tablet_manager.cc:1397] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260808 08:47:57.736325 21128 ts_tablet_manager.cc:1428] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:47:57.736475 21122 raft_consensus.cc:348] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.736752 21122 raft_consensus.cc:374] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:47:57.736881 21122 raft_consensus.cc:729] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f840c779bd0478b9736ac42ef36cd8c, State: Initialized, Role: FOLLOWER
I20260808 08:47:57.737135 21122 consensus_queue.cc:260] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.738797 20749 heartbeater.cc:503] Master 127.8.149.124:45897 was elected leader, sending a full tablet report...
I20260808 08:47:57.739916 21122 ts_tablet_manager.cc:1428] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:47:57.741497 21137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.740451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:56889)
0808 08:47:57.741065 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.741211 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":314,"threads_started":1}
I20260808 08:47:57.742492 20959 heartbeater.cc:503] Master 127.8.149.124:45897 was elected leader, sending a full tablet report...
I20260808 08:47:57.742867 21137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.742403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:48681)
0808 08:47:57.742620 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.742700 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 08:47:57.748793 21135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.737006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:37475)
0808 08:47:57.748476 (+ 11470us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.748607 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11375,"thread_start_us":11271,"threads_started":1}
I20260808 08:47:57.749675 21135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.749403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:40771)
0808 08:47:57.749524 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.749587 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:47:57.977052 21133 raft_consensus.cc:482] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:47:57.977324 21133 raft_consensus.cc:504] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.978163 21133 leader_election.cc:288] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187), 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:57.978749 20896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f615644b240494489a6aab0d40579c6" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f840c779bd0478b9736ac42ef36cd8c" is_pre_election: true
I20260808 08:47:57.978875 20462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f615644b240494489a6aab0d40579c6" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207354ebcfae4f84863ac0244cac8265" is_pre_election: true
I20260808 08:47:57.979113 20462 raft_consensus.cc:2454] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 0.
I20260808 08:47:57.979095 20896 raft_consensus.cc:2454] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 0.
I20260808 08:47:57.979642 20588 leader_election.cc:302] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112beb54a894960be11010a1c5776cb, 9f840c779bd0478b9736ac42ef36cd8c; no voters:
I20260808 08:47:57.979949 21133 raft_consensus.cc:2781] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:47:57.980072 21133 raft_consensus.cc:482] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:47:57.980192 21133 raft_consensus.cc:3037] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:57.982419 21133 raft_consensus.cc:504] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.983067 21133 leader_election.cc:288] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 election: Requested vote from peers 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187), 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231)
I20260808 08:47:57.983502 20896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f615644b240494489a6aab0d40579c6" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f840c779bd0478b9736ac42ef36cd8c"
I20260808 08:47:57.983587 20462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f615644b240494489a6aab0d40579c6" candidate_uuid: "1112beb54a894960be11010a1c5776cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207354ebcfae4f84863ac0244cac8265"
I20260808 08:47:57.983705 20896 raft_consensus.cc:3037] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:57.983803 20462 raft_consensus.cc:3037] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:47:57.986765 20462 raft_consensus.cc:2454] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 1.
I20260808 08:47:57.986765 20896 raft_consensus.cc:2454] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112beb54a894960be11010a1c5776cb in term 1.
I20260808 08:47:57.987167 20586 leader_election.cc:302] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112beb54a894960be11010a1c5776cb, 207354ebcfae4f84863ac0244cac8265; no voters:
I20260808 08:47:57.987426 21133 raft_consensus.cc:2781] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:47:57.987926 21133 raft_consensus.cc:686] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 1 LEADER]: Becoming Leader. State: Replica: 1112beb54a894960be11010a1c5776cb, State: Running, Role: LEADER
I20260808 08:47:57.988515 21133 consensus_queue.cc:237] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } }
I20260808 08:47:57.989001 21135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:57.988520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:54501)
0808 08:47:57.988703 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:57.988821 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:47:57.991230 20263 catalog_manager.cc:5495] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1112beb54a894960be11010a1c5776cb (127.8.149.66). New cstate: current_term: 1 leader_uuid: "1112beb54a894960be11010a1c5776cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1112beb54a894960be11010a1c5776cb" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 } health_report { overall_health: UNKNOWN } } }
I20260808 08:47:58.071187 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.066324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35700 (local address 127.8.149.66:45607)
0808 08:47:58.066564 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:58.066570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:58.066589 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:47:58.066677 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:58.066683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:58.066793 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:58.066916 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:47:58.067345 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.068152 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.069501 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.069944 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.070089 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:58.070490 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:47:58.070593 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:47:58.070692 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:58.070839 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 08:47:58.070917 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:47:58.074244 20462 raft_consensus.cc:1261] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Refusing update from remote peer 1112beb54a894960be11010a1c5776cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:58.074396 20896 raft_consensus.cc:1261] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Refusing update from remote peer 1112beb54a894960be11010a1c5776cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:47:58.074971 21140 consensus_queue.cc:1035] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "207354ebcfae4f84863ac0244cac8265" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:58.075352 21133 consensus_queue.cc:1035] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f840c779bd0478b9736ac42ef36cd8c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 35187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:47:58.077620 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.077117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:43643)
0808 08:47:58.077324 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.077445 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 08:47:58.078258 21137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.077764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:52955)
0808 08:47:58.077974 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.078065 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 08:47:58.082443 21137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.081953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.67:52885)
0808 08:47:58.082165 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.082256 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 08:47:58.084462 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.084029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.65:52899)
0808 08:47:58.084238 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.084316 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 08:47:58.086876 21135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.086412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.8.149.66:56929)
0808 08:47:58.086589 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.086682 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 08:47:58.086732 21145 mvcc.cc:205] Tried to move back new op lower bound from 7316188684586143744 to 7316188684243419136. Current Snapshot: MvccSnapshot[applied={T|T < 7316188684586143744 or (T in {7316188684586143744})}]
I20260808 08:47:58.091703 20263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:58.091952 20263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:47:58.097846 20263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 844376a1c37943148b022aef27108cb9: Sending DeleteTablet for 3 replicas of tablet 8f615644b240494489a6aab0d40579c6
I20260808 08:47:58.098657 20862 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f615644b240494489a6aab0d40579c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:58 UTC) from {username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:50234
I20260808 08:47:58.098794 20430 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f615644b240494489a6aab0d40579c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:58 UTC) from {username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:36048
I20260808 08:47:58.099270 20654 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f615644b240494489a6aab0d40579c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:47:58 UTC) from {username='oryx', principal='oryx/127.8.149.124@KRBTEST.COM'} at 127.0.0.1:35690
I20260808 08:47:58.099793 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 20246
I20260808 08:47:58.107671 21160 tablet_replica.cc:330] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: stopping tablet replica
I20260808 08:47:58.107782 21162 tablet_replica.cc:330] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: stopping tablet replica
I20260808 08:47:58.107893 21160 raft_consensus.cc:2229] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:58.107945 21162 raft_consensus.cc:2229] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:47:58.108282 21160 raft_consensus.cc:2258] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:58.108367 21162 raft_consensus.cc:2258] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:58.109441 21160 ts_tablet_manager.cc:1905] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:58.112514 21158 tablet_replica.cc:330] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: stopping tablet replica
I20260808 08:47:58.112768 21158 raft_consensus.cc:2229] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:47:58.113075 21158 raft_consensus.cc:2258] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:47:58.114166 21158 ts_tablet_manager.cc:1905] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:58.114323 21162 ts_tablet_manager.cc:1905] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:47:58.119230 21162 ts_tablet_manager.cc:1918] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:58.119395 21162 log.cc:1196] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/8f615644b240494489a6aab0d40579c6
I20260808 08:47:58.119946 21162 ts_tablet_manager.cc:1939] T 8f615644b240494489a6aab0d40579c6 P 1112beb54a894960be11010a1c5776cb: Deleting consensus metadata
I20260808 08:47:58.120802 21158 ts_tablet_manager.cc:1918] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:58.121088 20234 catalog_manager.cc:4841] TS 1112beb54a894960be11010a1c5776cb (127.8.149.66:45607): tablet 8f615644b240494489a6aab0d40579c6 (table test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]) successfully deleted
I20260808 08:47:58.121469 21158 log.cc:1196] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/8f615644b240494489a6aab0d40579c6
I20260808 08:47:58.121981 21160 ts_tablet_manager.cc:1918] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:47:58.122030 21158 ts_tablet_manager.cc:1939] T 8f615644b240494489a6aab0d40579c6 P 9f840c779bd0478b9736ac42ef36cd8c: Deleting consensus metadata
I20260808 08:47:58.122119 21160 log.cc:1196] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/8f615644b240494489a6aab0d40579c6
I20260808 08:47:58.122581 21160 ts_tablet_manager.cc:1939] T 8f615644b240494489a6aab0d40579c6 P 207354ebcfae4f84863ac0244cac8265: Deleting consensus metadata
I20260808 08:47:58.123412 20235 catalog_manager.cc:4841] TS 9f840c779bd0478b9736ac42ef36cd8c (127.8.149.67:35187): tablet 8f615644b240494489a6aab0d40579c6 (table test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]) successfully deleted
I20260808 08:47:58.123613 20233 catalog_manager.cc:4841] TS 207354ebcfae4f84863ac0244cac8265 (127.8.149.65:34231): tablet 8f615644b240494489a6aab0d40579c6 (table test-table [id=b0e4aba42ed24a61862b5ef6e7408b0c]) successfully deleted
I20260808 08:47:58.123922 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.100721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.8.149.65:34231)
0808 08:47:58.100973 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:58.100982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:58.104647 (+ 3665us) server_negotiation.cc:407] Connection header received
0808 08:47:58.104845 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:58.104852 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:58.104954 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:58.105081 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:58.107327 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.108478 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.110720 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.111316 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.111427 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:58.115146 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:58.115173 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:58.115191 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:58.115225 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:58.119260 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.120508 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.120521 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.120528 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.120721 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.121247 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.121254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.121259 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.121802 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:58.122118 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:58.123323 (+ 1205us) server_negotiation.cc:299] Negotiation successful
0808 08:47:58.123590 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:47:58.124585 20525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:58.216176 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 20246
I20260808 08:47:58.243209 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 20556
I20260808 08:47:58.256541 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.243941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.8.149.66:45607)
0808 08:47:58.244166 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:58.244170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:58.244190 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:47:58.244431 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:58.244436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:58.244548 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:58.244645 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:58.245939 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.246670 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.247811 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.248384 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.248485 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:58.251138 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:58.251152 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:58.251169 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:58.251200 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:58.253980 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.254715 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.254722 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.254724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.254898 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.255239 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.255241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.255243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.255554 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:58.255788 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:58.255987 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 08:47:58.256231 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:47:58.257169 20743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:58.296612 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.295828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59564)
0808 08:47:58.296309 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.296445 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":222,"threads_started":1}
I20260808 08:47:58.298350 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.297931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41123 (local address 127.0.0.1:59576)
0808 08:47:58.298108 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:47:58.298222 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:47:58.375811 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 20556
I20260808 08:47:58.410045 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 20765
I20260808 08:47:58.424331 21172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:47:58.410942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50248 (local address 127.8.149.67:35187)
0808 08:47:58.411489 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0808 08:47:58.411494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:47:58.411514 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:47:58.411577 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:47:58.411581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:47:58.411672 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:47:58.411780 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:47:58.413206 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.414033 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.415415 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:47:58.415837 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:47:58.415960 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:47:58.418568 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:47:58.418589 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:47:58.418607 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:47:58.418642 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:47:58.421503 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.422051 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.422057 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.422059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.422179 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:47:58.422465 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:47:58.422468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:47:58.422469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:47:58.422786 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:47:58.423018 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 08:47:58.423430 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 08:47:58.423794 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":293,"threads_started":1}
I20260808 08:47:58.425088 20952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:58.519479 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 20765
I20260808 08:47:58.546099 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 19747
I20260808 08:47:58.547293 20011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:58.664819 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 19747
I20260808 08:47:58.696744 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 19911
I20260808 08:47:58.697791 20309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:47:58.814831 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 19911
2026-08-08T08:47:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10265 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:47:58 dist-test-slave-7vjv krb5kdc[21185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:47:58 dist-test-slave-7vjv krb5kdc[21185](info): set up 2 sockets
Aug 08 08:47:58 dist-test-slave-7vjv krb5kdc[21185](info): commencing operation
krb5kdc: starting...
W20260808 08:48:00.153808 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:48:00 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:48:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab.
Entry for principal oryx/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab.
I20260808 08:48:00.387959 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33585
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab
--principal=oryx/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:33585
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:00.707813 21201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:00.708137 21201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:00.708300 21201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:00.715262 21201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:00.715387 21201 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:48:00.715482 21201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:00.715607 21201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:00.715690 21201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:00.715776 21201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:00.725394 21201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:33585
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.126.keytab
--principal=oryx/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:00.726509 21201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:00.727743 21201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:00.739357 21214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:00.739328 21211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:00.739732 21209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:00.740407 21201 server_base.cc:1034] running on GCE node
I20260808 08:48:00.741207 21201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:00.742543 21201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:00.743780 21201 hybrid_clock.cc:648] HybridClock initialized: now 1786178880743715 us; error 55 us; skew 500 ppm
I20260808 08:48:00.744083 21201 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:00 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178880, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:00.747251 21201 init.cc:377] Logged in from keytab as oryx/127.8.149.126@KRBTEST.COM (short username oryx)
I20260808 08:48:00.748790 21201 webserver.cc:460] Webserver started at http://127.8.149.126:34101/ using document root <none> and password file <none>
I20260808 08:48:00.749461 21201 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:00.749598 21201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:00.749948 21201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:00.752884 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "3392992a2db74c1497ff0762cb9efb6a"
format_stamp: "Formatted at 2026-08-08 08:48:00 on dist-test-slave-7vjv"
server_key: "5a3ceb1c6798dc251d4d385f33b96fed"
server_key_iv: "b55a5e96697ef3cc973df3cc64ba9502"
server_key_version: "encryptionkey@0"
I20260808 08:48:00.753676 21201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "3392992a2db74c1497ff0762cb9efb6a"
format_stamp: "Formatted at 2026-08-08 08:48:00 on dist-test-slave-7vjv"
server_key: "5a3ceb1c6798dc251d4d385f33b96fed"
server_key_iv: "b55a5e96697ef3cc973df3cc64ba9502"
server_key_version: "encryptionkey@0"
I20260808 08:48:00.758558 21201 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 08:48:00.761762 21223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:00.763020 21201 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:48:00.763190 21201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "3392992a2db74c1497ff0762cb9efb6a"
format_stamp: "Formatted at 2026-08-08 08:48:00 on dist-test-slave-7vjv"
server_key: "5a3ceb1c6798dc251d4d385f33b96fed"
server_key_iv: "b55a5e96697ef3cc973df3cc64ba9502"
server_key_version: "encryptionkey@0"
I20260808 08:48:00.763396 21201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:00.790684 21201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:00.794386 21201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:00.794672 21201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:00.816668 21201 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:33585
I20260808 08:48:00.816759 21331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:33585 every 8 connection(s)
I20260808 08:48:00.817924 21201 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:00.822124 21332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:00.827112 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 21201
I20260808 08:48:00.827363 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:48:00.828281 8789 external_mini_cluster.cc:1428] Setting key 7016c1364db2f60f37671275199345c7
I20260808 08:48:00.835039 21332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Bootstrap starting.
I20260808 08:48:00.838642 21332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:00.839879 21332 log.cc:824] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:00.843286 21332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: No bootstrap required, opened a new log
Aug 08 08:48:00 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:00.850833 21332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } }
I20260808 08:48:00.851251 21332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:00.851363 21332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3392992a2db74c1497ff0762cb9efb6a, State: Initialized, Role: FOLLOWER
I20260808 08:48:00.852072 21332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } }
I20260808 08:48:00.852334 21336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:00.830423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48846 (local address 127.8.149.126:33585)
0808 08:48:00.831195 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:00.831206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:00.831247 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:48:00.833467 (+ 2220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:00.833487 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:00.833827 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:00.834159 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:00.835955 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:00.837302 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:00.839123 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:00.839854 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:00.840084 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:00.844950 (+ 4866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:00.844957 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:00.844970 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:00.845017 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:00.848060 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:00.848809 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:00.848817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:00.848831 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:00.848988 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:00.849357 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:00.849362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:00.849367 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:00.849855 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:00.850203 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:00.850570 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 08:48:00.850969 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":360,"threads_started":1}
I20260808 08:48:00.852388 21332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:00.852515 21332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:00.852725 21332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:00.855064 21332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } }
I20260808 08:48:00.855546 21332 leader_election.cc:302] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3392992a2db74c1497ff0762cb9efb6a; no voters:
I20260808 08:48:00.856182 21332 leader_election.cc:288] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:48:00.856269 21338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:00.857034 21338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [term 1 LEADER]: Becoming Leader. State: Replica: 3392992a2db74c1497ff0762cb9efb6a, State: Running, Role: LEADER
I20260808 08:48:00.857625 21338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } }
I20260808 08:48:00.858253 21332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:00.860682 21340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3392992a2db74c1497ff0762cb9efb6a. Latest consensus state: current_term: 1 leader_uuid: "3392992a2db74c1497ff0762cb9efb6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } } }
I20260808 08:48:00.861167 21340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:00.862735 21352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:00.862677 21339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3392992a2db74c1497ff0762cb9efb6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3392992a2db74c1497ff0762cb9efb6a" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33585 } } }
I20260808 08:48:00.862967 21339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:00.868005 21352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:00.877722 21352 catalog_manager.cc:1347] Generated new cluster ID: b6cef209a1cf47bc81828c0b821da00a
I20260808 08:48:00.877831 21352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:00.887672 21352 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:48:00.888917 21352 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:00.901223 21352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Generated new TSK 0
I20260808 08:48:00.901947 21352 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
I20260808 08:48:00.969002 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33585
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:01.315356 21373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:01.315623 21373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:01.315766 21373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:01.323071 21373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:01.323179 21373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:01.323364 21373 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:48:01.323499 21373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:01.333173 21373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:33585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:01.334384 21373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:01.335888 21373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:01.349920 21380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:01.349993 21379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:01.349880 21382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:01.350857 21373 server_base.cc:1034] running on GCE node
I20260808 08:48:01.351531 21373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:01.352532 21373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:01.353778 21373 hybrid_clock.cc:648] HybridClock initialized: now 1786178881353703 us; error 54 us; skew 500 ppm
I20260808 08:48:01.354113 21373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:01 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178881, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:01.357352 21373 init.cc:377] Logged in from keytab as oryx/127.8.149.65@KRBTEST.COM (short username oryx)
I20260808 08:48:01.358776 21373 webserver.cc:460] Webserver started at http://127.8.149.65:41705/ using document root <none> and password file <none>
I20260808 08:48:01.359552 21373 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:01.359724 21373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:01.360069 21373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:01.362898 21373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "8f61f40c77cb41c49b77e608ee441f96"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "62eb1a1f1e5f68a5cca71004e47d8911"
server_key_iv: "c74a0598bb190a8f8ba91bb6186f4a04"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.363648 21373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "8f61f40c77cb41c49b77e608ee441f96"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "62eb1a1f1e5f68a5cca71004e47d8911"
server_key_iv: "c74a0598bb190a8f8ba91bb6186f4a04"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.368723 21373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:48:01.372315 21393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:01.373680 21373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:48:01.373904 21373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "8f61f40c77cb41c49b77e608ee441f96"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "62eb1a1f1e5f68a5cca71004e47d8911"
server_key_iv: "c74a0598bb190a8f8ba91bb6186f4a04"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.374161 21373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:01.387277 21373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:01.391904 21373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:01.392269 21373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:01.395396 21373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:01.395560 21373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:01.395764 21373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:01.395955 21373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:48:01 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178881, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:01.419072 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.395573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:35821 (local address 127.8.149.126:33585)
0808 08:48:01.396059 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:01.396065 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:01.397247 (+ 1182us) server_negotiation.cc:407] Connection header received
0808 08:48:01.400044 (+ 2797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:01.400053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:01.400199 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:01.400389 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:01.402323 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.403572 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.406274 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.406911 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.407047 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.411317 (+ 4270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:01.411324 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:01.411327 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:01.411359 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:01.414913 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.416036 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.416043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.416047 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.416290 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.416989 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.416996 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.416999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.417302 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:01.417476 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:01.418656 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0808 08:48:01.418817 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":241,"threads_started":1}
I20260808 08:48:01.421214 21409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.396144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.65:35821)
0808 08:48:01.397071 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:01.397118 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:01.399709 (+ 2591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:01.400655 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:01.400666 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:01.401185 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:01.402128 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.402154 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.403763 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.403775 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.406102 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.406122 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.407171 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.407182 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.407387 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.408148 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:01.408180 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:01.411087 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:01.415070 (+ 3983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.415079 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.415119 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.415849 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.416457 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.416463 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.416466 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.416815 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.417506 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:01.417517 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:01.418094 (+ 577us) client_negotiation.cc:769] Sending connection context
0808 08:48:01.418524 (+ 430us) client_negotiation.cc:240] Negotiation successful
0808 08:48:01.419202 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":458,"threads_started":1}
I20260808 08:48:01.442679 21518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.427988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.65:33467)
0808 08:48:01.428811 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:01.428838 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:01.429030 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:01.429438 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:01.429447 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:01.430311 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:01.430832 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.430851 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.432024 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.432029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.433839 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.433851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.434787 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.434793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.434944 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.435606 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:01.435622 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:01.436386 (+ 764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:01.439512 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.439519 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.439524 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.439967 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.440571 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.440580 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.440584 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.440723 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.441436 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:01.441441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:01.441746 (+ 305us) client_negotiation.cc:769] Sending connection context
0808 08:48:01.441961 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 08:48:01.442332 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":407,"threads_started":1}
I20260808 08:48:01.443300 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.428017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:33467 (local address 127.8.149.126:33585)
0808 08:48:01.428253 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:01.428260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:01.428960 (+ 700us) server_negotiation.cc:407] Connection header received
0808 08:48:01.429190 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:01.429194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:01.429265 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:01.429348 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:01.431023 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.431868 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.434029 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.434594 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.434721 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.436584 (+ 1863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:01.436590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:01.436595 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:01.436634 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:01.439332 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.440258 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.440264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.440268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.440420 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.440864 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.440869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.440873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.441273 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:01.441453 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:01.442438 (+ 985us) server_negotiation.cc:299] Negotiation successful
0808 08:48:01.442745 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:48:01.452832 21373 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:35213
I20260808 08:48:01.452875 21582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:35213 every 8 connection(s)
I20260808 08:48:01.454071 21373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:01.454792 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 21373
I20260808 08:48:01.455040 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:48:01.455994 8789 external_mini_cluster.cc:1428] Setting key 48c130353475428fe68d3a2ece57a33b
I20260808 08:48:01.456413 21586 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33585
I20260808 08:48:01.456640 21586 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:01.457348 21586 heartbeater.cc:511] Master 127.8.149.126:33585 requested a full tablet report, sending...
I20260808 08:48:01.459349 21251 ts_manager.cc:194] Registered new tserver with Master: 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213)
I20260808 08:48:01.460896 21251 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:35821
WARNING: no policy specified for oryx/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
I20260808 08:48:01.511348 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33585
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:01.835695 21594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:01.835937 21594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:01.836024 21594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:01.842698 21594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:01.842793 21594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:01.842870 21594 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:48:01.842954 21594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:01.852384 21594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:33585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:01.853423 21594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:01.854677 21594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:01.868044 21601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:01.868286 21602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:01.868325 21607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:01.868821 21594 server_base.cc:1034] running on GCE node
I20260808 08:48:01.869354 21594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:01.870083 21594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:01.871310 21594 hybrid_clock.cc:648] HybridClock initialized: now 1786178881871234 us; error 33 us; skew 500 ppm
I20260808 08:48:01.871624 21594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:01 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178881, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:01.874969 21594 init.cc:377] Logged in from keytab as oryx/127.8.149.66@KRBTEST.COM (short username oryx)
I20260808 08:48:01.876502 21594 webserver.cc:460] Webserver started at http://127.8.149.66:37997/ using document root <none> and password file <none>
I20260808 08:48:01.877264 21594 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:01.877394 21594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:01.877727 21594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:01.880566 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "273c5233f10c45ae822502c97634d781"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "f2ae13c46f895b2a41cf314c6d22612b"
server_key_iv: "84439b7f53d6e574efd53785a595c4fb"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.881423 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "273c5233f10c45ae822502c97634d781"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "f2ae13c46f895b2a41cf314c6d22612b"
server_key_iv: "84439b7f53d6e574efd53785a595c4fb"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.886304 21594 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:48:01.889654 21620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:01.890986 21594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260808 08:48:01.891178 21594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "273c5233f10c45ae822502c97634d781"
format_stamp: "Formatted at 2026-08-08 08:48:01 on dist-test-slave-7vjv"
server_key: "f2ae13c46f895b2a41cf314c6d22612b"
server_key_iv: "84439b7f53d6e574efd53785a595c4fb"
server_key_version: "encryptionkey@0"
I20260808 08:48:01.891404 21594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:01.902313 21594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:01.906440 21594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:01.906698 21594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:01.909435 21594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:01.909591 21594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:48:01.909755 21594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:01.909842 21594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:48:01 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178881, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:01.932482 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.909541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:50331 (local address 127.8.149.126:33585)
0808 08:48:01.909737 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:01.909743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:01.911126 (+ 1383us) server_negotiation.cc:407] Connection header received
0808 08:48:01.913265 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:01.913272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:01.913383 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:01.913522 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:01.915175 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.916048 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.919313 (+ 3265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.919792 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.919898 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.925581 (+ 5683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:01.925589 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:01.925596 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:01.925643 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:01.928922 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.929978 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.929986 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.929991 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.930149 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.930675 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.930682 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.930688 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.931014 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:01.931186 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:01.931863 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 08:48:01.932139 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:48:01.933485 21634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.910059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.66:50331)
0808 08:48:01.910932 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:01.910979 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:01.912933 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:01.913770 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:01.913785 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:01.914318 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:01.915001 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.915025 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.916247 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.916254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.919107 (+ 2853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.919128 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.920062 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.920073 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.920474 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.921262 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:01.921307 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:01.925322 (+ 4015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:01.929098 (+ 3776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.929110 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.929129 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.929751 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.930251 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.930256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.930259 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.930464 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.931150 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:01.931158 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:01.931501 (+ 343us) client_negotiation.cc:769] Sending connection context
0808 08:48:01.931758 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 08:48:01.932259 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":391,"threads_started":1}
I20260808 08:48:01.960763 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.943014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.66:55357)
0808 08:48:01.943894 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:01.943930 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:01.944139 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:01.945048 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:01.945057 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:01.945821 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:01.946342 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.946370 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.947398 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.947407 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.949745 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:01.949774 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.950817 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.950827 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:01.951083 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.951831 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:01.951861 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:01.953389 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:01.957280 (+ 3891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.957287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.957293 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.958066 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.958480 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:01.958485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:01.958488 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:01.958690 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:01.959538 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:01.959544 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:01.959785 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 08:48:01.959940 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 08:48:01.960292 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":443,"threads_started":1}
I20260808 08:48:01.961041 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:01.942964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:55357 (local address 127.8.149.126:33585)
0808 08:48:01.943432 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:01.943438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:01.944035 (+ 597us) server_negotiation.cc:407] Connection header received
0808 08:48:01.944292 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:01.944300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:01.944382 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:01.944491 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:01.946550 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.947241 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.949940 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:01.950567 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:01.950708 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:01.953671 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:01.953677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:01.953685 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:01.953740 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:01.957105 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.958220 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.958226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.958230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.958357 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:01.958842 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:01.958850 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:01.958855 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:01.959394 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:01.959583 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:01.960196 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 08:48:01.960503 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316}
I20260808 08:48:01.968241 21594 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:33407
I20260808 08:48:01.968276 21814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:33407 every 8 connection(s)
I20260808 08:48:01.969416 21594 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:01.971282 21816 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33585
I20260808 08:48:01.971481 21816 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:01.972086 21816 heartbeater.cc:511] Master 127.8.149.126:33585 requested a full tablet report, sending...
I20260808 08:48:01.973148 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 21594
I20260808 08:48:01.973315 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:48:01.973574 21251 ts_manager.cc:194] Registered new tserver with Master: 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407)
I20260808 08:48:01.973767 8789 external_mini_cluster.cc:1428] Setting key d88439ee45a371006be51b6647084b01
I20260808 08:48:01.974578 21251 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:50331
WARNING: no policy specified for oryx/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
I20260808 08:48:02.027907 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33585
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:02.359108 21824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:02.359365 21824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:02.359467 21824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:02.366459 21824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:02.366559 21824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:02.366644 21824 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:48:02.366722 21824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:02.375774 21824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.8.149.126:33585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:02.377065 21824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:02.378350 21824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:02.391976 21836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:02.392129 21839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:02.392131 21837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:02.393057 21824 server_base.cc:1034] running on GCE node
I20260808 08:48:02.393677 21824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:02.394654 21824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:02.395965 21824 hybrid_clock.cc:648] HybridClock initialized: now 1786178882395865 us; error 63 us; skew 500 ppm
I20260808 08:48:02.396311 21824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:02 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178882, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:02.399487 21824 init.cc:377] Logged in from keytab as oryx/127.8.149.67@KRBTEST.COM (short username oryx)
I20260808 08:48:02.400959 21824 webserver.cc:460] Webserver started at http://127.8.149.67:37019/ using document root <none> and password file <none>
I20260808 08:48:02.401659 21824 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:02.401800 21824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:02.402148 21824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:02.405095 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "7bd6178180b249bdba5f3de4e3b343af"
format_stamp: "Formatted at 2026-08-08 08:48:02 on dist-test-slave-7vjv"
server_key: "191eceae8b5711b72e01cef362c9be24"
server_key_iv: "ba6c4d45b29c4c1216b0d300d933e0ea"
server_key_version: "encryptionkey@0"
I20260808 08:48:02.405946 21824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "7bd6178180b249bdba5f3de4e3b343af"
format_stamp: "Formatted at 2026-08-08 08:48:02 on dist-test-slave-7vjv"
server_key: "191eceae8b5711b72e01cef362c9be24"
server_key_iv: "ba6c4d45b29c4c1216b0d300d933e0ea"
server_key_version: "encryptionkey@0"
I20260808 08:48:02.411036 21824 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:48:02.414585 21846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:02.415922 21824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:48:02.416170 21824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "7bd6178180b249bdba5f3de4e3b343af"
format_stamp: "Formatted at 2026-08-08 08:48:02 on dist-test-slave-7vjv"
server_key: "191eceae8b5711b72e01cef362c9be24"
server_key_iv: "ba6c4d45b29c4c1216b0d300d933e0ea"
server_key_version: "encryptionkey@0"
I20260808 08:48:02.416461 21824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:02.446182 21824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:02.450227 21824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:02.450528 21824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:02.453377 21824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:02.453487 21824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:02.453655 21824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:02.453783 21824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 08:48:02.464111 21586 heartbeater.cc:503] Master 127.8.149.126:33585 was elected leader, sending a full tablet report...
Aug 08 08:48:02 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178882, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:02.481258 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:02.454028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:35561 (local address 127.8.149.126:33585)
0808 08:48:02.454619 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:02.454626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:02.455714 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 08:48:02.458579 (+ 2865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:02.458590 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:02.458713 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:02.458830 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:02.461668 (+ 2838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.462587 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.466270 (+ 3683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.466739 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.466887 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:02.472458 (+ 5571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:02.472467 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:02.472474 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:02.472526 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:02.476616 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:02.477756 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:02.477763 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:02.477768 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:02.477950 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:02.478595 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:02.478603 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:02.478607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:02.479009 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:02.479175 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:02.480466 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0808 08:48:02.480759 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435}
I20260808 08:48:02.482735 21864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:02.454515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.67:35561)
0808 08:48:02.455529 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:02.455585 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:02.458224 (+ 2639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:02.459334 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:02.459354 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:02.460417 (+ 1063us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:02.461422 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:02.461465 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.462836 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.462844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:02.466069 (+ 3225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:02.466094 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.467009 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.467019 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:02.467427 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:02.468311 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:02.468344 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:02.472190 (+ 3846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:02.476769 (+ 4579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:02.476780 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:02.476799 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:02.477592 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:02.478116 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:02.478132 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:02.478136 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:02.478399 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:02.479275 (+ 876us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:02.479283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:02.479835 (+ 552us) client_negotiation.cc:769] Sending connection context
0808 08:48:02.480236 (+ 401us) client_negotiation.cc:240] Negotiation successful
0808 08:48:02.480905 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":388,"threads_started":1}
I20260808 08:48:02.505093 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:02.489538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:36279 (local address 127.8.149.126:33585)
0808 08:48:02.489738 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:02.489745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:02.490382 (+ 637us) server_negotiation.cc:407] Connection header received
0808 08:48:02.490652 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:02.490658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:02.490753 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:02.490872 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:02.491840 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.492869 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.495080 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.495522 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.495666 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:02.497868 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:02.497873 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:02.497877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:02.497907 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:02.501615 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:02.502556 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:02.502562 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:02.502567 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:02.502725 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:02.503275 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:02.503283 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:02.503288 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:02.503734 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:02.503910 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:02.504443 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 08:48:02.504664 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:48:02.505190 21978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:02.489581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.8.149.67:36279)
0808 08:48:02.490261 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:02.490284 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:02.490507 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:02.490884 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:02.490889 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:02.491386 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:02.491683 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:02.491692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.493041 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.493069 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:02.494886 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:02.494908 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.495727 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.495735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:02.495928 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:02.496573 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:02.496604 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:02.497637 (+ 1033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:02.501754 (+ 4117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:02.501761 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:02.501767 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:02.502337 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:02.502874 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:02.502893 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:02.502895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:02.503108 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:02.503919 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:02.503923 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:02.504083 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 08:48:02.504310 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 08:48:02.504649 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":374,"threads_started":1}
I20260808 08:48:02.509061 21824 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:39071
I20260808 08:48:02.509148 22037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:39071 every 8 connection(s)
I20260808 08:48:02.510167 21824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:02.512355 22040 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33585
I20260808 08:48:02.512590 22040 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:02.513199 22040 heartbeater.cc:511] Master 127.8.149.126:33585 requested a full tablet report, sending...
I20260808 08:48:02.514500 21249 ts_manager.cc:194] Registered new tserver with Master: 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:02.515273 21249 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:35561
I20260808 08:48:02.519147 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 21824
I20260808 08:48:02.519299 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:48:02.519769 8789 external_mini_cluster.cc:1428] Setting key 3334e484a17d3b9d042be4d948e3940e
I20260808 08:48:02.522616 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:48:02 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178882, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:48:02 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:02 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:02.977262 21816 heartbeater.cc:503] Master 127.8.149.126:33585 was elected leader, sending a full tablet report...
I20260808 08:48:03.517423 22040 heartbeater.cc:503] Master 127.8.149.126:33585 was elected leader, sending a full tablet report...
W20260808 08:48:03.648646 22054 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.075s user 0.000s sys 0.017s
W20260808 08:48:03.650053 21406 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:02.568376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.8.149.126:33585)
0808 08:48:02.568549 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:02.568554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:02.568961 (+ 407us) server_negotiation.cc:407] Connection header received
0808 08:48:02.569107 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:02.569111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:02.569172 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:02.569263 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:02.570537 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.571275 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.572672 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:02.573074 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:02.573165 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.649670 (+1076505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48860: BlockingRecv error: recv got EOF from 127.0.0.1:48860 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 08:48:03 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178882, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:03.675344 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.657749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48872 (local address 127.8.149.126:33585)
0808 08:48:03.657964 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.657971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.658301 (+ 330us) server_negotiation.cc:407] Connection header received
0808 08:48:03.658448 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.658452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.658527 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.658617 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:03.659870 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.661087 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.662541 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.663219 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.663365 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.670020 (+ 6655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:03.670025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:03.670028 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:03.670060 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:03.672852 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:03.673609 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:03.673613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:03.673615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:03.673739 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:03.674205 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:03.674208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:03.674210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:03.674481 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:03.674728 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.674963 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.675132 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:48:03.679629 21249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:48:03.686537 21249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:48:03.721419 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.698805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.0.0.1:51816)
0808 08:48:03.710667 (+ 11862us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:03.710700 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:03.710889 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:03.714373 (+ 3484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:03.714377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:03.714399 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:03.714761 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.714779 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.716489 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.716494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.718243 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.718255 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.720133 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720143 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.720369 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.720438 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 08:48:03.720598 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 08:48:03.720851 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11702,"mutex_wait_us":61,"thread_start_us":11537,"threads_started":1}
I20260808 08:48:03.721469 22084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.699500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51816 (local address 127.8.149.65:35213)
0808 08:48:03.713770 (+ 14270us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.713781 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.713812 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:48:03.713925 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.713934 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.714160 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.714381 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:03.714983 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.716352 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.718420 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.719846 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720004 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.720280 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.720955 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.721143 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14092,"thread_start_us":13915,"threads_started":1}
I20260808 08:48:03.721743 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.698804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52994 (local address 127.8.149.67:39071)
0808 08:48:03.712768 (+ 13964us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.712780 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.712816 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:48:03.712952 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.712962 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.713250 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.714179 (+ 929us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:03.714704 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.716148 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.719099 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.720482 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720646 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.720844 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.721294 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.721452 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13790,"thread_start_us":13644,"threads_started":1}
I20260808 08:48:03.722476 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.699454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:33407 (local address 127.0.0.1:59500)
0808 08:48:03.711653 (+ 12199us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:03.711684 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:03.711846 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:03.713089 (+ 1243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:03.713097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:03.713130 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:03.713699 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.713717 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.715762 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.715770 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.718560 (+ 2790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.718577 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.720803 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720813 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.721623 (+ 810us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.721678 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:48:03.721803 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:48:03.721969 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12004,"mutex_wait_us":6,"thread_start_us":10123,"threads_started":1}
I20260808 08:48:03.723413 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.700079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59500 (local address 127.8.149.66:33407)
0808 08:48:03.712491 (+ 12412us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.712498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.712526 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:48:03.712622 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.712627 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.712811 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.713091 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:03.713969 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.715616 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.718768 (+ 3152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.720085 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720275 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.720522 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.722875 (+ 2353us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.723053 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12245,"thread_start_us":12054,"threads_started":1}
I20260808 08:48:03.723495 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.698538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:39071 (local address 127.0.0.1:52994)
0808 08:48:03.709104 (+ 10566us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:03.709184 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:03.709388 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:03.713493 (+ 4105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:03.713502 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:03.713525 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:03.713996 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.714009 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.716297 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.716303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.718897 (+ 2594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.718911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.720816 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.720826 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.721067 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.721111 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:48:03.721236 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:48:03.721410 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10224,"mutex_wait_us":77,"thread_start_us":12691,"threads_started":1}
I20260808 08:48:03.725821 21471 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 (DEFAULT_TABLE table=test-table [id=8fda16124ad840f49b6778b44d88b4a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.727246 21471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39e9554e2c4eeaab08634757e97df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:03.726840 21934 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 (DEFAULT_TABLE table=test-table [id=8fda16124ad840f49b6778b44d88b4a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.726861 21703 tablet_service.cc:1467] Processing CreateTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 (DEFAULT_TABLE table=test-table [id=8fda16124ad840f49b6778b44d88b4a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.728071 21934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39e9554e2c4eeaab08634757e97df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:03.728201 21703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d39e9554e2c4eeaab08634757e97df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:03.739948 22087 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Bootstrap starting.
I20260808 08:48:03.744727 22087 tablet_bootstrap.cc:654] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:03.745049 22090 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Bootstrap starting.
I20260808 08:48:03.746467 22087 log.cc:824] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:03.747833 22089 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Bootstrap starting.
I20260808 08:48:03.748924 22090 tablet_bootstrap.cc:654] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:03.750265 22087 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: No bootstrap required, opened a new log
I20260808 08:48:03.750218 22090 log.cc:824] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:03.750542 22087 ts_tablet_manager.cc:1397] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260808 08:48:03.755179 22089 tablet_bootstrap.cc:654] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:03.756299 22089 log.cc:824] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:03.757730 22090 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: No bootstrap required, opened a new log
I20260808 08:48:03.758033 22090 ts_tablet_manager.cc:1397] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260808 08:48:03.759183 22089 tablet_bootstrap.cc:492] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: No bootstrap required, opened a new log
I20260808 08:48:03.759462 22089 ts_tablet_manager.cc:1397] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260808 08:48:03.759725 22087 raft_consensus.cc:348] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.760051 22087 raft_consensus.cc:374] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:03.760178 22087 raft_consensus.cc:729] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Initialized, Role: FOLLOWER
I20260808 08:48:03.760756 22087 consensus_queue.cc:260] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.765467 22087 ts_tablet_manager.cc:1428] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Time spent starting tablet: real 0.015s user 0.004s sys 0.010s
I20260808 08:48:03.768486 22090 raft_consensus.cc:348] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.768877 22090 raft_consensus.cc:374] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:03.768991 22090 raft_consensus.cc:729] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273c5233f10c45ae822502c97634d781, State: Initialized, Role: FOLLOWER
I20260808 08:48:03.769532 22090 consensus_queue.cc:260] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.771066 22090 ts_tablet_manager.cc:1428] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Time spent starting tablet: real 0.013s user 0.002s sys 0.012s
I20260808 08:48:03.771576 22089 raft_consensus.cc:348] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.771963 22089 raft_consensus.cc:374] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:03.772084 22089 raft_consensus.cc:729] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Initialized, Role: FOLLOWER
I20260808 08:48:03.772629 22089 consensus_queue.cc:260] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.774017 22089 ts_tablet_manager.cc:1428] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 08:48:03.862469 22095 raft_consensus.cc:482] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:03.862910 22095 raft_consensus.cc:504] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.864974 22095 leader_election.cc:288] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213), 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407)
I20260808 08:48:03.872565 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.865687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:59335 (local address 127.8.149.66:33407)
0808 08:48:03.865938 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.865944 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.866381 (+ 437us) server_negotiation.cc:407] Connection header received
0808 08:48:03.866679 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.866688 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.866799 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.866893 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:03.867687 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.868570 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.870711 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.871545 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.871768 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.871865 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.872142 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.872283 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:48:03.872611 22084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.865384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:45699 (local address 127.8.149.65:35213)
0808 08:48:03.865611 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.865619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.866559 (+ 940us) server_negotiation.cc:407] Connection header received
0808 08:48:03.866853 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.866857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.866974 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.867072 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:03.867872 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.868610 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.870740 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.871531 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.871678 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.871769 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.872254 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.872384 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:48:03.872689 22099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.865253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:33407 (local address 127.8.149.67:59335)
0808 08:48:03.866244 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:03.866264 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:03.866458 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:03.866928 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:03.866932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:03.866956 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:03.867508 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.867524 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.868727 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.868751 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.870537 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.870549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.871816 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.871824 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.871980 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.872005 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:48:03.872082 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 08:48:03.872267 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":75,"thread_start_us":584,"threads_started":1}
I20260808 08:48:03.872844 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.865339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.8.149.67:45699)
0808 08:48:03.866438 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:03.866459 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:03.866615 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:03.867171 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:03.867177 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:03.867204 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:03.867678 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.867691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.868805 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.868809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.870544 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:03.870558 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.871769 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.871777 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:03.872040 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.872084 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:48:03.872222 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 08:48:03.872343 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":5,"thread_start_us":777,"threads_started":1}
I20260808 08:48:03.873978 21504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39e9554e2c4eeaab08634757e97df9" candidate_uuid: "7bd6178180b249bdba5f3de4e3b343af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f61f40c77cb41c49b77e608ee441f96" is_pre_election: true
I20260808 08:48:03.874068 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39e9554e2c4eeaab08634757e97df9" candidate_uuid: "7bd6178180b249bdba5f3de4e3b343af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781" is_pre_election: true
I20260808 08:48:03.874529 21504 raft_consensus.cc:2454] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bd6178180b249bdba5f3de4e3b343af in term 0.
I20260808 08:48:03.874555 21744 raft_consensus.cc:2454] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bd6178180b249bdba5f3de4e3b343af in term 0.
I20260808 08:48:03.875263 21851 leader_election.cc:302] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bd6178180b249bdba5f3de4e3b343af, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:03.875695 22095 raft_consensus.cc:2781] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:03.875907 22095 raft_consensus.cc:482] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:03.876031 22095 raft_consensus.cc:3037] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:03.878597 22095 raft_consensus.cc:504] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.879254 22095 leader_election.cc:288] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [CANDIDATE]: Term 1 election: Requested vote from peers 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213), 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407)
I20260808 08:48:03.879766 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39e9554e2c4eeaab08634757e97df9" candidate_uuid: "7bd6178180b249bdba5f3de4e3b343af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781"
I20260808 08:48:03.879766 21504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d39e9554e2c4eeaab08634757e97df9" candidate_uuid: "7bd6178180b249bdba5f3de4e3b343af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f61f40c77cb41c49b77e608ee441f96"
I20260808 08:48:03.879995 21744 raft_consensus.cc:3037] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:03.880019 21504 raft_consensus.cc:3037] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:03.883332 21504 raft_consensus.cc:2454] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bd6178180b249bdba5f3de4e3b343af in term 1.
I20260808 08:48:03.883332 21744 raft_consensus.cc:2454] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bd6178180b249bdba5f3de4e3b343af in term 1.
I20260808 08:48:03.883754 21847 leader_election.cc:302] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 7bd6178180b249bdba5f3de4e3b343af; no voters:
I20260808 08:48:03.884138 22095 raft_consensus.cc:2781] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:03.884680 22095 raft_consensus.cc:686] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 1 LEADER]: Becoming Leader. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Running, Role: LEADER
I20260808 08:48:03.885231 22095 consensus_queue.cc:237] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } }
I20260808 08:48:03.889791 21249 catalog_manager.cc:5495] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67). New cstate: current_term: 1 leader_uuid: "7bd6178180b249bdba5f3de4e3b343af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } health_report { overall_health: UNKNOWN } } }
I20260808 08:48:03.912587 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:03.906757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53000 (local address 127.8.149.67:39071)
0808 08:48:03.906998 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:03.907005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:03.907131 (+ 126us) server_negotiation.cc:407] Connection header received
0808 08:48:03.907411 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:03.907415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:03.907528 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:03.907695 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:03.908170 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.908925 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.910385 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:03.910809 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:03.910956 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:03.911417 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:03.911923 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:03.912102 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:03.912222 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 08:48:03.912306 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:48:03.920691 21744 raft_consensus.cc:1261] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Refusing update from remote peer 7bd6178180b249bdba5f3de4e3b343af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:03.920699 21504 raft_consensus.cc:1261] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Refusing update from remote peer 7bd6178180b249bdba5f3de4e3b343af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:03.921919 22102 consensus_queue.cc:1035] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [LEADER]: Connected to new peer: Peer: permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:03.922353 22095 consensus_queue.cc:1035] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:03.947593 21251 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:03.947873 21251 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:03.951746 21251 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Sending DeleteTablet for 3 replicas of tablet 3d39e9554e2c4eeaab08634757e97df9
I20260808 08:48:03.952792 21934 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:03 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:52994
I20260808 08:48:03.953118 21703 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:03 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:59500
I20260808 08:48:03.953289 21471 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d39e9554e2c4eeaab08634757e97df9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:03 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51816
I20260808 08:48:03.955127 21251 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:48:03.956187 21251 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:48:03.966459 21470 tablet_service.cc:1467] Processing CreateTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 (DEFAULT_TABLE table=test-table [id=b2b444f6666e47cea029565262252ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.967141 21470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc6e311012b49ad9c5cc0d647d2ab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:03.972038 21700 tablet_service.cc:1467] Processing CreateTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 (DEFAULT_TABLE table=test-table [id=b2b444f6666e47cea029565262252ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.973100 21700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc6e311012b49ad9c5cc0d647d2ab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:03.984578 22089 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Bootstrap starting.
I20260808 08:48:03.984789 22126 tablet_replica.cc:330] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: stopping tablet replica
I20260808 08:48:03.986388 22089 tablet_bootstrap.cc:654] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:03.987277 22126 raft_consensus.cc:2229] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:03.987890 22126 raft_consensus.cc:2258] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:03.989303 22090 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Bootstrap starting.
I20260808 08:48:03.991823 22090 tablet_bootstrap.cc:654] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:03.994050 22123 tablet_replica.cc:330] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: stopping tablet replica
I20260808 08:48:03.994572 22123 raft_consensus.cc:2229] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:48:03.995314 21933 tablet_service.cc:1467] Processing CreateTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 (DEFAULT_TABLE table=test-table [id=b2b444f6666e47cea029565262252ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:03.996389 21933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc6e311012b49ad9c5cc0d647d2ab66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.000492 22123 raft_consensus.cc:2258] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:04.003003 22123 ts_tablet_manager.cc:1905] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.005241 22124 tablet_replica.cc:330] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: stopping tablet replica
I20260808 08:48:04.005654 22124 raft_consensus.cc:2229] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:04.006170 22124 raft_consensus.cc:2258] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:04.010696 22123 ts_tablet_manager.cc:1918] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:04.010874 22123 log.cc:1196] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/3d39e9554e2c4eeaab08634757e97df9
I20260808 08:48:04.011451 22123 ts_tablet_manager.cc:1939] T 3d39e9554e2c4eeaab08634757e97df9 P 7bd6178180b249bdba5f3de4e3b343af: Deleting consensus metadata
I20260808 08:48:04.011508 22126 ts_tablet_manager.cc:1905] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.013645 21226 catalog_manager.cc:4841] TS 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071): tablet 3d39e9554e2c4eeaab08634757e97df9 (table test-table [id=8fda16124ad840f49b6778b44d88b4a2]) successfully deleted
I20260808 08:48:04.017079 22087 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Bootstrap starting.
I20260808 08:48:04.018327 22124 ts_tablet_manager.cc:1905] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.018879 22087 tablet_bootstrap.cc:654] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.028822 22087 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: No bootstrap required, opened a new log
I20260808 08:48:04.029029 22087 ts_tablet_manager.cc:1397] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20260808 08:48:04.029024 22089 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: No bootstrap required, opened a new log
I20260808 08:48:04.029220 22089 ts_tablet_manager.cc:1397] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.029s
I20260808 08:48:04.029994 22087 raft_consensus.cc:348] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.031230 22087 raft_consensus.cc:374] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.031400 22087 raft_consensus.cc:729] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.031445 22090 tablet_bootstrap.cc:492] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: No bootstrap required, opened a new log
I20260808 08:48:04.031693 22090 ts_tablet_manager.cc:1397] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Time spent bootstrapping tablet: real 0.043s user 0.013s sys 0.015s
I20260808 08:48:04.031749 22087 consensus_queue.cc:260] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.032668 22090 raft_consensus.cc:348] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.032943 22090 raft_consensus.cc:374] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.033115 22090 raft_consensus.cc:729] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273c5233f10c45ae822502c97634d781, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.033535 22090 consensus_queue.cc:260] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.034870 22090 ts_tablet_manager.cc:1428] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:48:04.035552 22089 raft_consensus.cc:348] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.036159 22089 raft_consensus.cc:374] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.037225 22124 ts_tablet_manager.cc:1918] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:04.037427 22124 log.cc:1196] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/3d39e9554e2c4eeaab08634757e97df9
I20260808 08:48:04.038085 22124 ts_tablet_manager.cc:1939] T 3d39e9554e2c4eeaab08634757e97df9 P 273c5233f10c45ae822502c97634d781: Deleting consensus metadata
I20260808 08:48:04.038697 22087 ts_tablet_manager.cc:1428] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260808 08:48:04.039803 22089 raft_consensus.cc:729] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.040083 21224 catalog_manager.cc:4841] TS 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407): tablet 3d39e9554e2c4eeaab08634757e97df9 (table test-table [id=8fda16124ad840f49b6778b44d88b4a2]) successfully deleted
I20260808 08:48:04.040222 22089 consensus_queue.cc:260] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.039660 22126 ts_tablet_manager.cc:1918] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:04.040640 22126 log.cc:1196] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/3d39e9554e2c4eeaab08634757e97df9
I20260808 08:48:04.040848 22089 ts_tablet_manager.cc:1428] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260808 08:48:04.041342 22126 ts_tablet_manager.cc:1939] T 3d39e9554e2c4eeaab08634757e97df9 P 8f61f40c77cb41c49b77e608ee441f96: Deleting consensus metadata
I20260808 08:48:04.043159 21229 catalog_manager.cc:4841] TS 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213): tablet 3d39e9554e2c4eeaab08634757e97df9 (table test-table [id=8fda16124ad840f49b6778b44d88b4a2]) successfully deleted
I20260808 08:48:04.054432 22098 raft_consensus.cc:482] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:04.054612 22098 raft_consensus.cc:504] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.056351 22098 leader_election.cc:288] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.063875 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.056989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:41609 (local address 127.8.149.66:33407)
0808 08:48:04.057203 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.057210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.057481 (+ 271us) server_negotiation.cc:407] Connection header received
0808 08:48:04.057772 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.057778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.057853 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.057917 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:04.058782 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.059997 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.061891 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.062643 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.062818 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.062892 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.063441 (+ 549us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.063598 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:48:04.063949 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.056528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:33407 (local address 127.8.149.65:41609)
0808 08:48:04.057363 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:04.057398 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:04.057593 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:04.058163 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:04.058168 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:04.058194 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:04.058580 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.058592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.060180 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.060185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.061743 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.061754 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.063032 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.063037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.063221 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.063256 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:48:04.063357 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 08:48:04.063527 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":42,"spinlock_wait_cycles":7936,"thread_start_us":687,"threads_started":1}
I20260808 08:48:04.064795 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbc6e311012b49ad9c5cc0d647d2ab66" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781" is_pre_election: true
I20260808 08:48:04.065066 21744 raft_consensus.cc:2454] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.065198 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.056777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:60337 (local address 127.8.149.67:39071)
0808 08:48:04.056951 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.056958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.058015 (+ 1057us) server_negotiation.cc:407] Connection header received
0808 08:48:04.058238 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.058245 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.058338 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.058479 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:04.059345 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.060448 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.062760 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.064056 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.064266 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.064352 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.064744 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.064894 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:48:04.065202 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.056708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:39071 (local address 127.8.149.65:60337)
0808 08:48:04.057907 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:04.057928 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:04.058062 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:04.058676 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:04.058683 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:04.058709 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:04.059080 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.059093 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.060598 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.060603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.062586 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.062602 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.064355 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.064363 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.064512 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.064533 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:48:04.064696 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 08:48:04.064828 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":1,"thread_start_us":835,"threads_started":1}
I20260808 08:48:04.065613 21395 leader_election.cc:302] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.066056 22098 raft_consensus.cc:2781] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:04.066186 22098 raft_consensus.cc:482] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:04.066286 22098 raft_consensus.cc:3037] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.066717 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbc6e311012b49ad9c5cc0d647d2ab66" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af" is_pre_election: true
I20260808 08:48:04.067155 21959 raft_consensus.cc:2454] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.068890 22098 raft_consensus.cc:504] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.069425 22098 leader_election.cc:288] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Requested vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.069890 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbc6e311012b49ad9c5cc0d647d2ab66" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781"
I20260808 08:48:04.069947 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbc6e311012b49ad9c5cc0d647d2ab66" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af"
I20260808 08:48:04.070062 21744 raft_consensus.cc:3037] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.070159 21959 raft_consensus.cc:3037] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.072188 21744 raft_consensus.cc:2454] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.072614 21395 leader_election.cc:302] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.072863 22098 raft_consensus.cc:2781] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:04.073791 21959 raft_consensus.cc:2454] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.074223 22098 raft_consensus.cc:686] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 LEADER]: Becoming Leader. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Running, Role: LEADER
I20260808 08:48:04.074612 22098 consensus_queue.cc:237] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.077729 21249 catalog_manager.cc:5495] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65). New cstate: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:48:04 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178880, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.126@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:04.145300 22149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.130628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33585 (local address 127.0.0.1:48874)
0808 08:48:04.131251 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:04.131267 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:04.131383 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:04.131715 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:04.131718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:04.132492 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:04.132736 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.132744 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.134178 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.134181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.135304 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.135317 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.136247 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.136252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.136400 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.137014 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:04.137029 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:04.139273 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:04.142881 (+ 3608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:04.142891 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:04.142897 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:04.143283 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:04.143706 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:04.143709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:04.143711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:04.143850 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:04.144446 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:04.144451 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:04.144590 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 08:48:04.144718 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 08:48:04.144957 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":362,"threads_started":1}
I20260808 08:48:04.145787 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.130531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48874 (local address 127.8.149.126:33585)
0808 08:48:04.130698 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.130703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.131358 (+ 655us) server_negotiation.cc:407] Connection header received
0808 08:48:04.131495 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.131501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.131579 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.131681 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:04.132893 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.134031 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.135454 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.136052 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.136242 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.139456 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:04.139462 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:04.139467 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:04.139501 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:04.142748 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:04.143409 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:04.143414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:04.143418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:04.143555 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:04.143964 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:04.143969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:04.143973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:04.144301 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:04.144468 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.144951 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.145162 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:48:04.151211 21249 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:48874:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:48:04.152405 21249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:48:04.159439 21470 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0680c9a37463cb63e43dcd1a7ccc6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fca4c5b61eb64683bf01f3263268cfc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:48:04.159508 21703 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0680c9a37463cb63e43dcd1a7ccc6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fca4c5b61eb64683bf01f3263268cfc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:48:04.159808 21933 tablet_service.cc:1467] Processing CreateTablet for tablet ddd0680c9a37463cb63e43dcd1a7ccc6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fca4c5b61eb64683bf01f3263268cfc0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:48:04.160025 21470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0680c9a37463cb63e43dcd1a7ccc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.160043 21703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0680c9a37463cb63e43dcd1a7ccc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.160315 21933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddd0680c9a37463cb63e43dcd1a7ccc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.165804 22087 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: Bootstrap starting.
I20260808 08:48:04.167124 22090 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: Bootstrap starting.
I20260808 08:48:04.167124 22089 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: Bootstrap starting.
I20260808 08:48:04.167606 22087 tablet_bootstrap.cc:654] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.168823 22089 tablet_bootstrap.cc:654] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.168859 22090 tablet_bootstrap.cc:654] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.180078 22087 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: No bootstrap required, opened a new log
I20260808 08:48:04.180287 22087 ts_tablet_manager.cc:1397] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260808 08:48:04.180306 22089 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: No bootstrap required, opened a new log
I20260808 08:48:04.180469 22089 ts_tablet_manager.cc:1397] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260808 08:48:04.181057 22089 raft_consensus.cc:348] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.181061 22087 raft_consensus.cc:348] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.181275 22089 raft_consensus.cc:374] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.181300 22087 raft_consensus.cc:374] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.181361 22089 raft_consensus.cc:729] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.181402 22087 raft_consensus.cc:729] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.181636 22089 consensus_queue.cc:260] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.181715 22087 consensus_queue.cc:260] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.182063 22098 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.182242 22089 ts_tablet_manager.cc:1428] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:48:04.182363 22098 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.182222 22095 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.182482 22095 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.183485 22090 tablet_bootstrap.cc:492] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: No bootstrap required, opened a new log
I20260808 08:48:04.183660 22090 ts_tablet_manager.cc:1397] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20260808 08:48:04.184473 22090 raft_consensus.cc:348] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.184727 22090 raft_consensus.cc:374] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.184805 22090 raft_consensus.cc:729] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273c5233f10c45ae822502c97634d781, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.185130 22090 consensus_queue.cc:260] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.185747 22090 ts_tablet_manager.cc:1428] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:48:04.185720 22096 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.186141 22096 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.186786 22087 ts_tablet_manager.cc:1428] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
W20260808 08:48:04.208777 21587 tablet.cc:2369] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:48:04.225277 21820 tablet.cc:2369] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:48:04.262851 22041 tablet.cc:2369] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:48:04.396333 22098 raft_consensus.cc:482] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:04.396576 22098 raft_consensus.cc:504] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.397271 22098 leader_election.cc:288] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.397776 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd0680c9a37463cb63e43dcd1a7ccc6" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781" is_pre_election: true
I20260808 08:48:04.397922 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd0680c9a37463cb63e43dcd1a7ccc6" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af" is_pre_election: true
I20260808 08:48:04.398069 21744 raft_consensus.cc:2454] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.398176 21959 raft_consensus.cc:2454] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.398578 21397 leader_election.cc:302] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bd6178180b249bdba5f3de4e3b343af, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.398904 22098 raft_consensus.cc:2781] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:04.399025 22098 raft_consensus.cc:482] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:04.399148 22098 raft_consensus.cc:3037] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.402117 22098 raft_consensus.cc:504] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.402704 22098 leader_election.cc:288] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Requested vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.403118 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd0680c9a37463cb63e43dcd1a7ccc6" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781"
I20260808 08:48:04.403149 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddd0680c9a37463cb63e43dcd1a7ccc6" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af"
I20260808 08:48:04.403349 21959 raft_consensus.cc:3037] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.403337 21744 raft_consensus.cc:3037] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.405431 21744 raft_consensus.cc:2454] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.405872 21395 leader_election.cc:302] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.406169 22098 raft_consensus.cc:2781] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:04.406365 22098 raft_consensus.cc:686] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 LEADER]: Becoming Leader. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Running, Role: LEADER
I20260808 08:48:04.406366 21959 raft_consensus.cc:2454] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.407207 22098 consensus_queue.cc:237] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.408810 22139 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: TxnStatusTablet state changed. Reason: New leader 8f61f40c77cb41c49b77e608ee441f96. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.409148 22139 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:48:04.409747 22160 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:48:04.409943 22160 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:48:04.411098 21248 catalog_manager.cc:5495] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65). New cstate: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } health_report { overall_health: UNKNOWN } } }
I20260808 08:48:04.468334 22149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.461047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.0.0.1:51830)
0808 08:48:04.461299 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:04.461326 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:04.461497 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:04.462583 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:04.462588 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:04.462620 (+ 32us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:48:04.462899 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.462916 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.464257 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.464266 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.465329 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.465343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.466265 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.466271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.466480 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.466537 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.467699 (+ 1162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.467722 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:48:04.467812 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:48:04.467971 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:48:04.468844 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.461481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.8.149.65:35213)
0808 08:48:04.462172 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.462176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.462194 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:48:04.462272 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.462275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.462381 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.462560 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:04.463097 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.464062 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.465493 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.466097 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.466250 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.466775 (+ 525us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.467573 (+ 798us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.467722 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.467870 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.467961 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":381,"threads_started":1}
I20260808 08:48:04.473592 21744 raft_consensus.cc:1261] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Refusing update from remote peer 8f61f40c77cb41c49b77e608ee441f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:04.474107 21959 raft_consensus.cc:1261] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Refusing update from remote peer 8f61f40c77cb41c49b77e608ee441f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:04.474413 22139 consensus_queue.cc:1035] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:04.475070 22098 consensus_queue.cc:1035] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:04.487962 22096 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: TxnStatusTablet state changed. Reason: New leader 8f61f40c77cb41c49b77e608ee441f96. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.488248 22096 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.492789 22171 mvcc.cc:205] Tried to move back new op lower bound from 7316188710796349440 to 7316188710534037504. Current Snapshot: MvccSnapshot[applied={T|T < 7316188710796349440}]
I20260808 08:48:04.493247 22095 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: TxnStatusTablet state changed. Reason: New leader 8f61f40c77cb41c49b77e608ee441f96. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.493546 22095 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.496332 22098 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.496716 22098 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:48:04.497260 22098 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.498377 22098 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 8f61f40c77cb41c49b77e608ee441f96: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:48:04.506929 22096 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.507212 22096 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 273c5233f10c45ae822502c97634d781: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.510388 22095 tablet_replica.cc:439] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } } }
I20260808 08:48:04.510659 22095 tablet_replica.cc:442] T ddd0680c9a37463cb63e43dcd1a7ccc6 P 7bd6178180b249bdba5f3de4e3b343af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:48:04.522149 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.513413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.8.149.65:35213)
0808 08:48:04.513605 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.513614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.516655 (+ 3041us) server_negotiation.cc:407] Connection header received
0808 08:48:04.516909 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.516914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.516997 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.517111 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:04.517631 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.518464 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.520042 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.520797 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.520943 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.521387 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.521509 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.521627 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.521782 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.521865 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:48:04.529138 22098 consensus_queue.cc:1035] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:04.551697 22139 consensus_queue.cc:1035] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 08:48:04.560431 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.548760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.8.149.65:48941)
0808 08:48:04.552378 (+ 3618us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:04.552398 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:04.552579 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:04.553171 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:04.553176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:04.553190 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:48:04.553722 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.553741 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.555910 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.555919 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.557904 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:04.557922 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.558927 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.558934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:04.559112 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.559186 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.559671 (+ 485us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.559682 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:48:04.559764 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 08:48:04.559974 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3408,"thread_start_us":3216,"threads_started":1}
I20260808 08:48:04.560496 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.548431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:48941 (local address 127.8.149.65:35213)
0808 08:48:04.549656 (+ 1225us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.549662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.552464 (+ 2802us) server_negotiation.cc:407] Connection header received
0808 08:48:04.552742 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.552748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.552887 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.552988 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:04.553967 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.555669 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.558059 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.558706 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.558854 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.559409 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.559541 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.559670 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.559807 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.559927 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:48:04.625077 21248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:04.625326 21248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:04.628297 21248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Sending DeleteTablet for 3 replicas of tablet bbc6e311012b49ad9c5cc0d647d2ab66
I20260808 08:48:04.629179 21703 tablet_service.cc:1514] Processing DeleteTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:59500
I20260808 08:48:04.629381 21933 tablet_service.cc:1514] Processing DeleteTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:52994
I20260808 08:48:04.631754 21470 tablet_service.cc:1514] Processing DeleteTablet for tablet bbc6e311012b49ad9c5cc0d647d2ab66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51816
I20260808 08:48:04.640264 22195 tablet_replica.cc:330] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: stopping tablet replica
I20260808 08:48:04.641206 22197 tablet_replica.cc:330] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: stopping tablet replica
I20260808 08:48:04.641284 22194 tablet_replica.cc:330] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: stopping tablet replica
I20260808 08:48:04.641561 22195 raft_consensus.cc:2229] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:04.641563 22194 raft_consensus.cc:2229] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:04.641814 22195 raft_consensus.cc:2258] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:04.641871 22194 raft_consensus.cc:2258] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:04.642149 22197 raft_consensus.cc:2229] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:48:04.642777 22197 raft_consensus.cc:2258] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:04.643245 22194 ts_tablet_manager.cc:1905] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.643839 22195 ts_tablet_manager.cc:1905] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.646800 22197 ts_tablet_manager.cc:1905] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:04.650403 22194 ts_tablet_manager.cc:1918] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:04.653494 22195 ts_tablet_manager.cc:1918] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:04.653684 22195 log.cc:1196] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/bbc6e311012b49ad9c5cc0d647d2ab66
I20260808 08:48:04.654249 22195 ts_tablet_manager.cc:1939] T bbc6e311012b49ad9c5cc0d647d2ab66 P 7bd6178180b249bdba5f3de4e3b343af: Deleting consensus metadata
I20260808 08:48:04.654608 22197 ts_tablet_manager.cc:1918] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:04.654808 22197 log.cc:1196] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/bbc6e311012b49ad9c5cc0d647d2ab66
I20260808 08:48:04.655380 22197 ts_tablet_manager.cc:1939] T bbc6e311012b49ad9c5cc0d647d2ab66 P 8f61f40c77cb41c49b77e608ee441f96: Deleting consensus metadata
I20260808 08:48:04.655417 21226 catalog_manager.cc:4841] TS 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071): tablet bbc6e311012b49ad9c5cc0d647d2ab66 (table test-table [id=b2b444f6666e47cea029565262252ced]) successfully deleted
I20260808 08:48:04.656262 22194 log.cc:1196] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/bbc6e311012b49ad9c5cc0d647d2ab66
I20260808 08:48:04.656767 22194 ts_tablet_manager.cc:1939] T bbc6e311012b49ad9c5cc0d647d2ab66 P 273c5233f10c45ae822502c97634d781: Deleting consensus metadata
I20260808 08:48:04.657186 21229 catalog_manager.cc:4841] TS 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213): tablet bbc6e311012b49ad9c5cc0d647d2ab66 (table test-table [id=b2b444f6666e47cea029565262252ced]) successfully deleted
I20260808 08:48:04.657855 21224 catalog_manager.cc:4841] TS 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407): tablet bbc6e311012b49ad9c5cc0d647d2ab66 (table test-table [id=b2b444f6666e47cea029565262252ced]) successfully deleted
Aug 08 08:48:04 dist-test-slave-7vjv krb5kdc[21185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:48:04 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:04 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:48:04.705366 22210 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:04.692436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48888 (local address 127.8.149.126:33585)
0808 08:48:04.692988 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.692995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.693271 (+ 276us) server_negotiation.cc:407] Connection header received
0808 08:48:04.693455 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.693459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.693530 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.693642 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:04.695254 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.696229 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.698049 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.698511 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.698608 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.705038 (+ 6430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48888: BlockingRecv error: recv got EOF from 127.0.0.1:48888 (error 108)
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":256,"threads_started":1}
Aug 08 08:48:04 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM
I20260808 08:48:04.724509 22210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.708437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.8.149.126:33585)
0808 08:48:04.708660 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.708667 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.708939 (+ 272us) server_negotiation.cc:407] Connection header received
0808 08:48:04.709145 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.709151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.709240 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.709375 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:04.710762 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.711547 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.713040 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.713503 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.713655 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.718068 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:04.718075 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:04.718079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:04.718124 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:04.721696 (+ 3572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:04.722343 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:04.722349 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:04.722352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:04.722531 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:04.722906 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:04.722911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:04.722914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:04.723269 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:04.723549 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.723840 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.724082 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:48:04.728456 21248 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:48:04.729200 21248 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:48:04.736945 21470 tablet_service.cc:1467] Processing CreateTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 (DEFAULT_TABLE table=test-table [id=7cf9e209ff844cde816cde1a707b1029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:04.736964 21703 tablet_service.cc:1467] Processing CreateTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 (DEFAULT_TABLE table=test-table [id=7cf9e209ff844cde816cde1a707b1029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:04.737413 21470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2180be0312d44e08e1bbb48b5d63d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.737428 21703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2180be0312d44e08e1bbb48b5d63d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.743412 22221 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Bootstrap starting.
I20260808 08:48:04.744449 21933 tablet_service.cc:1467] Processing CreateTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 (DEFAULT_TABLE table=test-table [id=7cf9e209ff844cde816cde1a707b1029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:04.744925 21933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2180be0312d44e08e1bbb48b5d63d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:04.746855 22221 tablet_bootstrap.cc:654] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.754415 22225 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Bootstrap starting.
I20260808 08:48:04.755985 22225 tablet_bootstrap.cc:654] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.756731 22223 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Bootstrap starting.
I20260808 08:48:04.758015 22221 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: No bootstrap required, opened a new log
I20260808 08:48:04.758164 22221 ts_tablet_manager.cc:1397] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260808 08:48:04.758863 22223 tablet_bootstrap.cc:654] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:04.759094 22221 raft_consensus.cc:348] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.759359 22221 raft_consensus.cc:374] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.759486 22221 raft_consensus.cc:729] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.759641 22225 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: No bootstrap required, opened a new log
I20260808 08:48:04.759833 22225 ts_tablet_manager.cc:1397] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:48:04.759747 22221 consensus_queue.cc:260] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.760347 22221 ts_tablet_manager.cc:1428] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 08:48:04.760607 22225 raft_consensus.cc:348] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.760821 22225 raft_consensus.cc:374] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.760910 22225 raft_consensus.cc:729] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.761145 22225 consensus_queue.cc:260] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.763744 22225 ts_tablet_manager.cc:1428] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260808 08:48:04.764401 22223 tablet_bootstrap.cc:492] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: No bootstrap required, opened a new log
I20260808 08:48:04.764581 22223 ts_tablet_manager.cc:1397] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:48:04.765379 22223 raft_consensus.cc:348] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.765712 22223 raft_consensus.cc:374] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:04.765867 22223 raft_consensus.cc:729] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273c5233f10c45ae822502c97634d781, State: Initialized, Role: FOLLOWER
I20260808 08:48:04.766163 22223 consensus_queue.cc:260] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.766739 22223 ts_tablet_manager.cc:1428] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:48:04.947808 22098 raft_consensus.cc:482] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:04.948009 22098 raft_consensus.cc:504] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.948807 22098 leader_election.cc:288] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.949314 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2180be0312d44e08e1bbb48b5d63d32" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781" is_pre_election: true
I20260808 08:48:04.949435 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2180be0312d44e08e1bbb48b5d63d32" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af" is_pre_election: true
I20260808 08:48:04.949704 21959 raft_consensus.cc:2454] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.949698 21744 raft_consensus.cc:2454] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 0.
I20260808 08:48:04.950140 21397 leader_election.cc:302] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bd6178180b249bdba5f3de4e3b343af, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.950459 22098 raft_consensus.cc:2781] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:04.950626 22098 raft_consensus.cc:482] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:04.950724 22098 raft_consensus.cc:3037] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.954077 22098 raft_consensus.cc:504] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.954733 22098 leader_election.cc:288] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Requested vote from peers 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:04.955200 21744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2180be0312d44e08e1bbb48b5d63d32" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273c5233f10c45ae822502c97634d781"
I20260808 08:48:04.955233 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2180be0312d44e08e1bbb48b5d63d32" candidate_uuid: "8f61f40c77cb41c49b77e608ee441f96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af"
I20260808 08:48:04.955422 21744 raft_consensus.cc:3037] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.955470 21959 raft_consensus.cc:3037] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:04.957672 21744 raft_consensus.cc:2454] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.958206 21395 leader_election.cc:302] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 8f61f40c77cb41c49b77e608ee441f96; no voters:
I20260808 08:48:04.958556 22098 raft_consensus.cc:2781] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:04.958619 21959 raft_consensus.cc:2454] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f61f40c77cb41c49b77e608ee441f96 in term 1.
I20260808 08:48:04.958755 22098 raft_consensus.cc:686] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 LEADER]: Becoming Leader. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Running, Role: LEADER
I20260808 08:48:04.959069 22098 consensus_queue.cc:237] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:04.963168 21248 catalog_manager.cc:5495] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65). New cstate: current_term: 1 leader_uuid: "8f61f40c77cb41c49b77e608ee441f96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } health_report { overall_health: UNKNOWN } } }
I20260808 08:48:04.982064 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:04.976561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51850 (local address 127.8.149.65:35213)
0808 08:48:04.976782 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:04.976788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:04.976994 (+ 206us) server_negotiation.cc:407] Connection header received
0808 08:48:04.977236 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:04.977245 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:04.977323 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:04.977425 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:04.977860 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.978753 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.980292 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:04.980791 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:04.980934 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:04.981361 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:04.981473 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:04.981577 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:04.981707 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 08:48:04.981782 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:48:04.985004 21744 raft_consensus.cc:1261] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Refusing update from remote peer 8f61f40c77cb41c49b77e608ee441f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:04.985157 21959 raft_consensus.cc:1261] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Refusing update from remote peer 8f61f40c77cb41c49b77e608ee441f96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:04.985740 22139 consensus_queue.cc:1035] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:04.986338 22139 consensus_queue.cc:1035] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:04.989897 22170 mvcc.cc:205] Tried to move back new op lower bound from 7316188712892174336 to 7316188712795398144. Current Snapshot: MvccSnapshot[applied={T|T < 7316188712892174336}]
I20260808 08:48:04.995766 21248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:04.996014 21248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:05.002493 21933 tablet_service.cc:1514] Processing DeleteTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:52994
I20260808 08:48:05.002547 21470 tablet_service.cc:1514] Processing DeleteTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51816
I20260808 08:48:05.002837 22197 tablet_replica.cc:330] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: stopping tablet replica
I20260808 08:48:05.003057 22197 raft_consensus.cc:2229] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:48:05.003232 22195 tablet_replica.cc:330] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: stopping tablet replica
I20260808 08:48:05.003355 22197 raft_consensus.cc:2258] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.003405 22195 raft_consensus.cc:2229] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:05.003599 22195 raft_consensus.cc:2258] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.004578 22197 ts_tablet_manager.cc:1905] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.006115 22195 ts_tablet_manager.cc:1905] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.011792 22197 ts_tablet_manager.cc:1918] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:05.012004 21248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Sending DeleteTablet for 3 replicas of tablet e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.012610 22195 ts_tablet_manager.cc:1918] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:05.012756 22195 log.cc:1196] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.013134 22195 ts_tablet_manager.cc:1939] T e2180be0312d44e08e1bbb48b5d63d32 P 7bd6178180b249bdba5f3de4e3b343af: Deleting consensus metadata
I20260808 08:48:05.013721 21703 tablet_service.cc:1514] Processing DeleteTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:59500
I20260808 08:48:05.014035 22194 tablet_replica.cc:330] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: stopping tablet replica
I20260808 08:48:05.014226 22194 raft_consensus.cc:2229] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:05.014487 22194 raft_consensus.cc:2258] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.015568 21933 tablet_service.cc:1514] Processing DeleteTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:52994
I20260808 08:48:05.015694 22194 ts_tablet_manager.cc:1905] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.016283 22197 log.cc:1196] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.012893 21470 tablet_service.cc:1514] Processing DeleteTablet for tablet e2180be0312d44e08e1bbb48b5d63d32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:04 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51816
I20260808 08:48:05.017242 22197 ts_tablet_manager.cc:1939] T e2180be0312d44e08e1bbb48b5d63d32 P 8f61f40c77cb41c49b77e608ee441f96: Deleting consensus metadata
W20260808 08:48:05.017395 21226 catalog_manager.cc:4808] TS 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071): delete failed for tablet e2180be0312d44e08e1bbb48b5d63d32 because the tablet was not found. No further retry: Not found: Tablet not found: e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.018086 21249 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:48:05.018769 21249 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260808 08:48:05.020481 21229 catalog_manager.cc:4808] TS 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213): delete failed for tablet e2180be0312d44e08e1bbb48b5d63d32 because the tablet was not found. No further retry: Not found: Tablet not found: e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.021903 22194 ts_tablet_manager.cc:1918] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:05.022076 22194 log.cc:1196] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/e2180be0312d44e08e1bbb48b5d63d32
I20260808 08:48:05.022433 22194 ts_tablet_manager.cc:1939] T e2180be0312d44e08e1bbb48b5d63d32 P 273c5233f10c45ae822502c97634d781: Deleting consensus metadata
I20260808 08:48:05.023432 21224 catalog_manager.cc:4841] TS 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407): tablet e2180be0312d44e08e1bbb48b5d63d32 (table test-table [id=7cf9e209ff844cde816cde1a707b1029]) successfully deleted
I20260808 08:48:05.025759 21470 tablet_service.cc:1467] Processing CreateTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba (DEFAULT_TABLE table=test-table [id=f5b2d239a0ca41748ad782fb81ff5000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:05.025952 21703 tablet_service.cc:1467] Processing CreateTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba (DEFAULT_TABLE table=test-table [id=f5b2d239a0ca41748ad782fb81ff5000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:05.026206 21470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80388b5b004d4264bfc8f7fcdf2274ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:05.026276 21703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80388b5b004d4264bfc8f7fcdf2274ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:05.029022 21933 tablet_service.cc:1467] Processing CreateTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba (DEFAULT_TABLE table=test-table [id=f5b2d239a0ca41748ad782fb81ff5000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:05.029413 21933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80388b5b004d4264bfc8f7fcdf2274ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:05.031147 22223 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Bootstrap starting.
I20260808 08:48:05.032819 22223 tablet_bootstrap.cc:654] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:05.035312 22221 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Bootstrap starting.
I20260808 08:48:05.035914 22225 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Bootstrap starting.
I20260808 08:48:05.037448 22221 tablet_bootstrap.cc:654] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:05.037645 22225 tablet_bootstrap.cc:654] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:05.040477 22225 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: No bootstrap required, opened a new log
I20260808 08:48:05.040742 22225 ts_tablet_manager.cc:1397] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 08:48:05.040822 22223 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: No bootstrap required, opened a new log
I20260808 08:48:05.040982 22223 ts_tablet_manager.cc:1397] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260808 08:48:05.041690 22223 raft_consensus.cc:348] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.041688 22225 raft_consensus.cc:348] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.041939 22223 raft_consensus.cc:374] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:05.042039 22223 raft_consensus.cc:729] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273c5233f10c45ae822502c97634d781, State: Initialized, Role: FOLLOWER
I20260808 08:48:05.042079 22225 raft_consensus.cc:374] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:05.042255 22225 raft_consensus.cc:729] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd6178180b249bdba5f3de4e3b343af, State: Initialized, Role: FOLLOWER
I20260808 08:48:05.042354 22223 consensus_queue.cc:260] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.042573 22225 consensus_queue.cc:260] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.043666 22223 ts_tablet_manager.cc:1428] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 08:48:05.046257 22225 ts_tablet_manager.cc:1428] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260808 08:48:05.047806 22221 tablet_bootstrap.cc:492] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: No bootstrap required, opened a new log
I20260808 08:48:05.048048 22221 ts_tablet_manager.cc:1397] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.003s
I20260808 08:48:05.048974 22221 raft_consensus.cc:348] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.049248 22221 raft_consensus.cc:374] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:05.049345 22221 raft_consensus.cc:729] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61f40c77cb41c49b77e608ee441f96, State: Initialized, Role: FOLLOWER
I20260808 08:48:05.049582 22221 consensus_queue.cc:260] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.050115 22221 ts_tablet_manager.cc:1428] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:48:05.054586 22096 raft_consensus.cc:482] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:05.054773 22096 raft_consensus.cc:504] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.056120 22096 leader_election.cc:288] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:05.064738 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.056426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:39071 (local address 127.8.149.66:45543)
0808 08:48:05.058117 (+ 1691us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:05.058138 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:05.058271 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:05.058814 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:05.058818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:05.058846 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:05.059216 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.059228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.060448 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.060454 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.062021 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.062034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.063804 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.063813 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.064015 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.064049 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:48:05.064214 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 08:48:05.064345 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1529,"thread_start_us":1357,"threads_started":1}
I20260808 08:48:05.064742 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.056887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:45543 (local address 127.8.149.67:39071)
0808 08:48:05.057625 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.057633 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.058326 (+ 693us) server_negotiation.cc:407] Connection header received
0808 08:48:05.058433 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.058456 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.058528 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.058620 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:05.059410 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.060320 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.062194 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.063414 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.063605 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.063682 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.064241 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.064372 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":773,"threads_started":1}
I20260808 08:48:05.064991 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.056615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:45765 (local address 127.8.149.65:35213)
0808 08:48:05.056766 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.056772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.057040 (+ 268us) server_negotiation.cc:407] Connection header received
0808 08:48:05.057261 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.057266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.057337 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.057424 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:05.058575 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.059804 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.062369 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.063725 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.063896 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.063982 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.064441 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.064613 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:48:05.065583 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80388b5b004d4264bfc8f7fcdf2274ba" candidate_uuid: "273c5233f10c45ae822502c97634d781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af" is_pre_election: true
I20260808 08:48:05.065871 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.056307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.8.149.66:45765)
0808 08:48:05.056867 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:05.056896 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:05.057043 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:05.057967 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:05.057973 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:05.058015 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:05.058380 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.058392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.059961 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.059967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.062203 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.062221 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.063998 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.064005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.064237 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.064275 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:48:05.065375 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0808 08:48:05.065524 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":1,"thread_start_us":745,"threads_started":1}
I20260808 08:48:05.065855 21959 raft_consensus.cc:2454] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 273c5233f10c45ae822502c97634d781 in term 0.
I20260808 08:48:05.066409 21625 leader_election.cc:302] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 7bd6178180b249bdba5f3de4e3b343af; no voters:
I20260808 08:48:05.066753 21504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80388b5b004d4264bfc8f7fcdf2274ba" candidate_uuid: "273c5233f10c45ae822502c97634d781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f61f40c77cb41c49b77e608ee441f96" is_pre_election: true
I20260808 08:48:05.066876 22096 raft_consensus.cc:2781] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:05.066993 22096 raft_consensus.cc:482] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:05.067034 21504 raft_consensus.cc:2454] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 273c5233f10c45ae822502c97634d781 in term 0.
I20260808 08:48:05.067090 22096 raft_consensus.cc:3037] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:05.069389 22096 raft_consensus.cc:504] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.070024 22096 leader_election.cc:288] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [CANDIDATE]: Term 1 election: Requested vote from peers 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213), 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071)
I20260808 08:48:05.070459 21504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80388b5b004d4264bfc8f7fcdf2274ba" candidate_uuid: "273c5233f10c45ae822502c97634d781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f61f40c77cb41c49b77e608ee441f96"
I20260808 08:48:05.070694 21504 raft_consensus.cc:3037] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:05.070645 21959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80388b5b004d4264bfc8f7fcdf2274ba" candidate_uuid: "273c5233f10c45ae822502c97634d781" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bd6178180b249bdba5f3de4e3b343af"
I20260808 08:48:05.070850 21959 raft_consensus.cc:3037] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:05.073772 21959 raft_consensus.cc:2454] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 273c5233f10c45ae822502c97634d781 in term 1.
I20260808 08:48:05.073796 21504 raft_consensus.cc:2454] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 273c5233f10c45ae822502c97634d781 in term 1.
I20260808 08:48:05.074172 21625 leader_election.cc:302] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273c5233f10c45ae822502c97634d781, 7bd6178180b249bdba5f3de4e3b343af; no voters:
I20260808 08:48:05.074435 22096 raft_consensus.cc:2781] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:05.074919 22096 raft_consensus.cc:686] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 1 LEADER]: Becoming Leader. State: Replica: 273c5233f10c45ae822502c97634d781, State: Running, Role: LEADER
I20260808 08:48:05.075419 22096 consensus_queue.cc:237] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } }
I20260808 08:48:05.078835 21248 catalog_manager.cc:5495] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 reported cstate change: term changed from 0 to 1, leader changed from <none> to 273c5233f10c45ae822502c97634d781 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "273c5233f10c45ae822502c97634d781" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "273c5233f10c45ae822502c97634d781" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 33407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 } health_report { overall_health: UNKNOWN } } }
I20260808 08:48:05.105463 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.098929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.8.149.66:33407)
0808 08:48:05.099503 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.099509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.099532 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:48:05.099634 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.099639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.099728 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.099896 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:05.100324 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.101399 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.102691 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.103334 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.103453 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.103881 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:05.104693 (+ 812us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:05.104848 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.104946 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.105076 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":301,"threads_started":1}
I20260808 08:48:05.121384 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.115902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:32839 (local address 127.8.149.65:35213)
0808 08:48:05.116131 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.116137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.116577 (+ 440us) server_negotiation.cc:407] Connection header received
0808 08:48:05.116770 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.116774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.116833 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.116927 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:05.117391 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.118140 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.119578 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.120180 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.120342 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.120714 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:05.120823 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:05.120903 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.121037 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.121107 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:48:05.121507 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.115822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35213 (local address 127.8.149.66:32839)
0808 08:48:05.116475 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:05.116496 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:05.116640 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:05.116940 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:05.116944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:05.116954 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:48:05.117253 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.117261 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.118289 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.118294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.119381 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.119410 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.120357 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.120364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.120495 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.120547 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:48:05.120906 (+ 359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:48:05.120919 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 08:48:05.121010 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 08:48:05.121126 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":410,"threads_started":1}
I20260808 08:48:05.130203 21959 raft_consensus.cc:1261] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Refusing update from remote peer 273c5233f10c45ae822502c97634d781: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:05.130347 21504 raft_consensus.cc:1261] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Refusing update from remote peer 273c5233f10c45ae822502c97634d781: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:05.130939 22250 consensus_queue.cc:1035] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bd6178180b249bdba5f3de4e3b343af" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 39071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:05.131747 22250 consensus_queue.cc:1035] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f61f40c77cb41c49b77e608ee441f96" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:05.157050 22175 mvcc.cc:205] Tried to move back new op lower bound from 7316188713488052224 to 7316188713273466880. Current Snapshot: MvccSnapshot[applied={T|T < 7316188713488052224}]
I20260808 08:48:05.178155 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.171212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:54137 (local address 127.8.149.66:33407)
0808 08:48:05.171473 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.171483 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.171962 (+ 479us) server_negotiation.cc:407] Connection header received
0808 08:48:05.172201 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.172208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.172291 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.172415 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:05.173016 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.174249 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.176217 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.176653 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.176804 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.177240 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:05.177350 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:05.177463 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.177673 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.177755 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:48:05.178188 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.171134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:33407 (local address 127.8.149.65:54137)
0808 08:48:05.171826 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:05.171847 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:05.171994 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:05.172442 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:05.172447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:05.172469 (+ 22us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:48:05.172833 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.172843 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.174543 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.174548 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.176009 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:05.176023 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.176856 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.176865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:05.177038 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.177076 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:48:05.177464 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:48:05.177479 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 08:48:05.177636 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 08:48:05.177778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":359,"threads_started":1}
I20260808 08:48:05.217082 21248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:05.217350 21248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:05.221004 21248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3392992a2db74c1497ff0762cb9efb6a: Sending DeleteTablet for 3 replicas of tablet 80388b5b004d4264bfc8f7fcdf2274ba
I20260808 08:48:05.221724 21470 tablet_service.cc:1514] Processing DeleteTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:05 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51816
I20260808 08:48:05.222021 22197 tablet_replica.cc:330] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: stopping tablet replica
I20260808 08:48:05.222107 21933 tablet_service.cc:1514] Processing DeleteTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:05 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:52994
I20260808 08:48:05.222201 22197 raft_consensus.cc:2229] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:05.222398 22195 tablet_replica.cc:330] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: stopping tablet replica
I20260808 08:48:05.222422 22197 raft_consensus.cc:2258] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.222570 22195 raft_consensus.cc:2229] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:05.222767 22195 raft_consensus.cc:2258] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.223726 21703 tablet_service.cc:1514] Processing DeleteTablet for tablet 80388b5b004d4264bfc8f7fcdf2274ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:05 UTC) from {username='oryx', principal='oryx/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:59500
I20260808 08:48:05.223909 22197 ts_tablet_manager.cc:1905] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.224056 22194 tablet_replica.cc:330] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: stopping tablet replica
I20260808 08:48:05.224295 22194 raft_consensus.cc:2229] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:48:05.224876 22194 raft_consensus.cc:2258] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:05.226393 22195 ts_tablet_manager.cc:1905] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.231384 22197 ts_tablet_manager.cc:1918] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:05.231595 22197 log.cc:1196] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/80388b5b004d4264bfc8f7fcdf2274ba
I20260808 08:48:05.232154 22197 ts_tablet_manager.cc:1939] T 80388b5b004d4264bfc8f7fcdf2274ba P 8f61f40c77cb41c49b77e608ee441f96: Deleting consensus metadata
I20260808 08:48:05.232964 22194 ts_tablet_manager.cc:1905] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:05.233417 21229 catalog_manager.cc:4841] TS 8f61f40c77cb41c49b77e608ee441f96 (127.8.149.65:35213): tablet 80388b5b004d4264bfc8f7fcdf2274ba (table test-table [id=f5b2d239a0ca41748ad782fb81ff5000]) successfully deleted
I20260808 08:48:05.240974 22195 ts_tablet_manager.cc:1918] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:05.241195 22195 log.cc:1196] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/80388b5b004d4264bfc8f7fcdf2274ba
I20260808 08:48:05.241679 22195 ts_tablet_manager.cc:1939] T 80388b5b004d4264bfc8f7fcdf2274ba P 7bd6178180b249bdba5f3de4e3b343af: Deleting consensus metadata
I20260808 08:48:05.240059 22194 ts_tablet_manager.cc:1918] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:48:05.242897 21226 catalog_manager.cc:4841] TS 7bd6178180b249bdba5f3de4e3b343af (127.8.149.67:39071): tablet 80388b5b004d4264bfc8f7fcdf2274ba (table test-table [id=f5b2d239a0ca41748ad782fb81ff5000]) successfully deleted
I20260808 08:48:05.243005 22194 log.cc:1196] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/80388b5b004d4264bfc8f7fcdf2274ba
I20260808 08:48:05.243592 22194 ts_tablet_manager.cc:1939] T 80388b5b004d4264bfc8f7fcdf2274ba P 273c5233f10c45ae822502c97634d781: Deleting consensus metadata
I20260808 08:48:05.243741 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 21373
I20260808 08:48:05.244911 21224 catalog_manager.cc:4841] TS 273c5233f10c45ae822502c97634d781 (127.8.149.66:33407): tablet 80388b5b004d4264bfc8f7fcdf2274ba (table test-table [id=f5b2d239a0ca41748ad782fb81ff5000]) successfully deleted
Aug 08 08:48:05 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.65@KRBTEST.COM
I20260808 08:48:05.264945 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.245033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.8.149.65:35213)
0808 08:48:05.245229 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.245235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.245774 (+ 539us) server_negotiation.cc:407] Connection header received
0808 08:48:05.245934 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.245940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.246063 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.246188 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:05.247713 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.248895 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.250614 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.251349 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.251492 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.256880 (+ 5388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:05.256914 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:05.256935 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:05.256980 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:05.261552 (+ 4572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.262462 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.262472 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.262476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.262662 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.263126 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.263131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.263134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.263595 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:05.263977 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.264309 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.264557 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:48:05.265655 21578 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:05.420500 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 21373
I20260808 08:48:05.461946 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 21594
Aug 08 08:48:05 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.66@KRBTEST.COM
I20260808 08:48:05.479070 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.462834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59512 (local address 127.8.149.66:33407)
0808 08:48:05.463033 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.463041 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.463065 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:48:05.463303 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.463307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.463387 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.463507 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:05.464761 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.465531 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.466958 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.467506 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.467658 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.471976 (+ 4318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:05.471996 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:05.472012 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:05.472070 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:05.476088 (+ 4018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.476783 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.476792 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.476795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.476966 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.477439 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.477444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.477447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.477932 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:05.478280 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.478466 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.478674 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:48:05.480062 21805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:05.626120 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 21594
I20260808 08:48:05.649850 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 21824
Aug 08 08:48:05 dist-test-slave-7vjv krb5kdc[21185](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.8.149.67@KRBTEST.COM
I20260808 08:48:05.665611 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:05.650638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53016 (local address 127.8.149.67:39071)
0808 08:48:05.651104 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:05.651109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:05.651125 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:48:05.651181 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:05.651185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:05.651251 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:05.651345 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:05.652956 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.653639 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.654958 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:05.655333 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:05.655419 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:05.660266 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:05.660280 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:05.660297 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:05.660330 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:05.663171 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.663834 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.663841 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.663843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.664011 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:05.664411 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:05.664415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:05.664417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:05.664743 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:05.665003 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:05.665188 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 08:48:05.665343 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":248,"threads_started":1}
I20260808 08:48:05.666224 22031 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:05.789543 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 21824
I20260808 08:48:05.823918 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 21201
I20260808 08:48:05.825183 21324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:05.940466 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 21201
2026-08-08T08:48:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7120 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:48:06 dist-test-slave-7vjv krb5kdc[22287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:48:06 dist-test-slave-7vjv krb5kdc[22287](info): set up 2 sockets
Aug 08 08:48:06 dist-test-slave-7vjv krb5kdc[22287](info): commencing operation
krb5kdc: starting...
W20260808 08:48:07.241133 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:48:07 dist-test-slave-7vjv krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:48:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:48:07.473147 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:45009
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:45073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:45009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:07.788726 22307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:07.789059 22307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:07.789212 22307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:07.796406 22307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:07.796552 22307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:07.796654 22307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:07.796751 22307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:07.796836 22307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:07.806598 22307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:45073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:45009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:45009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:07.807685 22307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:07.808914 22307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:07.820744 22316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:07.820782 22315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:07.820699 22319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:07.821504 22307 server_base.cc:1034] running on GCE node
I20260808 08:48:07.822170 22307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:07.823359 22307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:07.824568 22307 hybrid_clock.cc:648] HybridClock initialized: now 1786178887824517 us; error 47 us; skew 500 ppm
I20260808 08:48:07.824889 22307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T08:48:07Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1953 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:48:08 dist-test-slave-7vjv krb5kdc[22331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:48:08 dist-test-slave-7vjv krb5kdc[22331](info): set up 2 sockets
Aug 08 08:48:08 dist-test-slave-7vjv krb5kdc[22331](info): commencing operation
krb5kdc: starting...
W20260808 08:48:09.192363 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:48:09 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:48:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:48:09.428033 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36541
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:36541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:09.746348 22346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:09.746592 22346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:09.746762 22346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:09.753515 22346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:09.753619 22346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:09.753722 22346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:09.753798 22346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:09.753861 22346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:09.763329 22346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:36541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:09.764503 22346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:09.765748 22346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:09.777096 22352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:09.777141 22359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:09.777112 22353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:09.777916 22346 server_base.cc:1034] running on GCE node
I20260808 08:48:09.778646 22346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:09.779946 22346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:09.781172 22346 hybrid_clock.cc:648] HybridClock initialized: now 1786178889781114 us; error 47 us; skew 500 ppm
I20260808 08:48:09.781513 22346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:09 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:09.787061 22346 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:48:09.788452 22346 webserver.cc:460] Webserver started at http://127.8.149.126:34205/ using document root <none> and password file <none>
I20260808 08:48:09.789070 22346 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:09.789178 22346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:09.789459 22346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:09.792446 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "b4728d2385214be6ab92a590fe38f983"
format_stamp: "Formatted at 2026-08-08 08:48:09 on dist-test-slave-7vjv"
server_key: "0074eef9519b323db8bf62e6d4bf0bae"
server_key_iv: "c49d1a63dacffaee6bc971831c4a71f6"
server_key_version: "encryptionkey@0"
I20260808 08:48:09.793447 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "b4728d2385214be6ab92a590fe38f983"
format_stamp: "Formatted at 2026-08-08 08:48:09 on dist-test-slave-7vjv"
server_key: "0074eef9519b323db8bf62e6d4bf0bae"
server_key_iv: "c49d1a63dacffaee6bc971831c4a71f6"
server_key_version: "encryptionkey@0"
I20260808 08:48:09.798645 22346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:48:09.802006 22373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:09.803254 22346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:48:09.803454 22346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "b4728d2385214be6ab92a590fe38f983"
format_stamp: "Formatted at 2026-08-08 08:48:09 on dist-test-slave-7vjv"
server_key: "0074eef9519b323db8bf62e6d4bf0bae"
server_key_iv: "c49d1a63dacffaee6bc971831c4a71f6"
server_key_version: "encryptionkey@0"
I20260808 08:48:09.803638 22346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:09.846702 22346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:09.850651 22346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:09.850940 22346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:09.870056 22346 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:36541
I20260808 08:48:09.870083 22462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:36541 every 8 connection(s)
I20260808 08:48:09.871301 22346 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:09.875051 22463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:09.877995 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 22346
I20260808 08:48:09.878207 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:48:09.878859 8789 external_mini_cluster.cc:1428] Setting key 2a5ec4d37bb11817929548ccfe952184
I20260808 08:48:09.887162 22463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Bootstrap starting.
I20260808 08:48:09.890802 22463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:09.892141 22463 log.cc:824] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:48:09 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:09.894858 22463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: No bootstrap required, opened a new log
I20260808 08:48:09.901497 22468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:09.880821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.8.149.126:36541)
0808 08:48:09.881543 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:09.881554 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:09.881594 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:48:09.883159 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:09.883178 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:09.883559 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:09.883856 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:09.885705 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:09.886944 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:09.888731 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:09.889439 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:09.889579 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:09.894434 (+ 4855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:09.894442 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:09.894454 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:09.894487 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:09.897549 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:09.898255 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:09.898261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:09.898266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:09.898423 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:09.898858 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:09.898869 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:09.898871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:09.899373 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:09.899718 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:09.900170 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:48:09.900557 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":337,"threads_started":1}
I20260808 08:48:09.902513 22463 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:09.902880 22463 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:09.903028 22463 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4728d2385214be6ab92a590fe38f983, State: Initialized, Role: FOLLOWER
I20260808 08:48:09.903654 22463 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:09.903936 22463 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:09.904151 22463 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:09.904332 22463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:09.906361 22463 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:09.906888 22463 leader_election.cc:302] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4728d2385214be6ab92a590fe38f983; no voters:
I20260808 08:48:09.907583 22463 leader_election.cc:288] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:48:09.907717 22470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:09.908430 22470 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 LEADER]: Becoming Leader. State: Replica: b4728d2385214be6ab92a590fe38f983, State: Running, Role: LEADER
I20260808 08:48:09.909065 22470 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:09.909961 22463 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:09.911985 22472 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4728d2385214be6ab92a590fe38f983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } } }
I20260808 08:48:09.912420 22472 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:09.911883 22473 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4728d2385214be6ab92a590fe38f983. Latest consensus state: current_term: 1 leader_uuid: "b4728d2385214be6ab92a590fe38f983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } } }
I20260808 08:48:09.913101 22473 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:09.914449 22477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:09.919348 22477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:09.928267 22477 catalog_manager.cc:1347] Generated new cluster ID: 05b8edbb88774ffb9ab025a0d0f95c3a
I20260808 08:48:09.928364 22477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:09.960173 22477 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:48:09.962000 22477 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:09.969789 22477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Generated new TSK 0
I20260808 08:48:09.970697 22477 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:48:10.039561 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:10.362485 22503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:10.362716 22503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:10.362854 22503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:10.369730 22503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:10.369824 22503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:10.369993 22503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:10.379027 22503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:10.380193 22503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:10.381443 22503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:10.394307 22512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:10.394345 22513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:10.394361 22516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:10.395788 22503 server_base.cc:1034] running on GCE node
I20260808 08:48:10.396502 22503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:10.397423 22503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:10.398666 22503 hybrid_clock.cc:648] HybridClock initialized: now 1786178890398620 us; error 61 us; skew 500 ppm
I20260808 08:48:10.398986 22503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:10 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178890, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:10.402683 22503 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:48:10.404047 22503 webserver.cc:460] Webserver started at http://127.8.149.65:40105/ using document root <none> and password file <none>
I20260808 08:48:10.404749 22503 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:10.404899 22503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:10.405239 22503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:10.408450 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "55f4ab783f8646d58e707b8beef09be0"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "4a626a0d62676dfd1db3194294f3281a"
server_key_iv: "6672509de6a085ca1c94fe2d943a8892"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.409230 22503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "55f4ab783f8646d58e707b8beef09be0"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "4a626a0d62676dfd1db3194294f3281a"
server_key_iv: "6672509de6a085ca1c94fe2d943a8892"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.414599 22503 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:48:10.418040 22530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:10.419287 22503 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:48:10.419462 22503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "55f4ab783f8646d58e707b8beef09be0"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "4a626a0d62676dfd1db3194294f3281a"
server_key_iv: "6672509de6a085ca1c94fe2d943a8892"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.419672 22503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:10.452064 22503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:10.456364 22503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:10.456661 22503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:10.457538 22503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:10.458932 22503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:10.459003 22503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:10.459147 22503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:10.459203 22503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:10.493695 22503 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:39101
I20260808 08:48:10.493777 22717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:39101 every 8 connection(s)
I20260808 08:48:10.494946 22503 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:10.502264 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 22503
I20260808 08:48:10.502562 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:48:10.503569 8789 external_mini_cluster.cc:1428] Setting key 60484027484d47d737993368bed90230
Aug 08 08:48:10 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178890, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:10.517112 22720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:10.497618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:43365 (local address 127.8.149.126:36541)
0808 08:48:10.498046 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:10.498051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:10.498984 (+ 933us) server_negotiation.cc:407] Connection header received
0808 08:48:10.500882 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:10.500887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:10.500969 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:10.501081 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:10.502606 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:10.503891 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:10.506038 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:10.506763 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:10.506898 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:10.510270 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:10.510278 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:10.510285 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:10.510328 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:10.513892 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:10.514568 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:10.514576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:10.514581 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:10.514726 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:10.515106 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:10.515113 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:10.515118 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:10.515502 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:10.515641 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:10.516372 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 08:48:10.516616 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":211,"threads_started":1}
I20260808 08:48:10.517807 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:10.498152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:43365)
0808 08:48:10.498825 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:10.498867 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:10.500602 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:10.501297 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:10.501304 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:10.501832 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:10.502366 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:10.502394 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:10.504063 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:10.504067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:10.505884 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:10.505900 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:10.506967 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:10.506972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:10.507217 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:10.507900 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:10.507924 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:10.510001 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:10.514022 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:10.514027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:10.514046 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:10.514441 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:10.514839 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:10.514842 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:10.514844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:10.514997 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:10.515617 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:10.515622 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:10.515915 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 08:48:10.516222 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 08:48:10.516650 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":290,"threads_started":1}
I20260808 08:48:10.519435 22718 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36541
I20260808 08:48:10.519708 22718 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:10.520434 22718 heartbeater.cc:511] Master 127.8.149.126:36541 requested a full tablet report, sending...
I20260808 08:48:10.522743 22407 ts_manager.cc:194] Registered new tserver with Master: 55f4ab783f8646d58e707b8beef09be0 (127.8.149.65:39101)
I20260808 08:48:10.524861 22407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:43365
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:48:10.560736 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:10.882341 22726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:10.882668 22726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:10.882797 22726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:10.893383 22726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:10.893481 22726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:10.893595 22726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:10.902899 22726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:10.903971 22726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:10.905241 22726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:10.918803 22737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:10.918939 22734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:10.919123 22740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:10.919926 22726 server_base.cc:1034] running on GCE node
I20260808 08:48:10.920610 22726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:10.921518 22726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:10.922717 22726 hybrid_clock.cc:648] HybridClock initialized: now 1786178890922680 us; error 26 us; skew 500 ppm
I20260808 08:48:10.923030 22726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:10 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178890, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:10.926287 22726 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:48:10.927601 22726 webserver.cc:460] Webserver started at http://127.8.149.66:45475/ using document root <none> and password file <none>
I20260808 08:48:10.928328 22726 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:10.928475 22726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:10.928776 22726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:10.931515 22726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "532dda75b18c4ec3add95759f05f409e"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "956c4faa2e83a8fff83d2a4c651ea0c9"
server_key_iv: "7f717b6186bbf1e3f13ae24df6e10ba0"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.932344 22726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "532dda75b18c4ec3add95759f05f409e"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "956c4faa2e83a8fff83d2a4c651ea0c9"
server_key_iv: "7f717b6186bbf1e3f13ae24df6e10ba0"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.937263 22726 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:48:10.940502 22753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:10.941720 22726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:48:10.941890 22726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "532dda75b18c4ec3add95759f05f409e"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "956c4faa2e83a8fff83d2a4c651ea0c9"
server_key_iv: "7f717b6186bbf1e3f13ae24df6e10ba0"
server_key_version: "encryptionkey@0"
I20260808 08:48:10.942123 22726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:10.960039 22726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:10.964334 22726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:10.964568 22726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:10.965380 22726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:10.966619 22726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:10.966689 22726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:10.966773 22726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:10.966817 22726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:11.000566 22726 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:35781
I20260808 08:48:11.000696 22928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:35781 every 8 connection(s)
I20260808 08:48:11.001899 22726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:11.010974 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 22726
I20260808 08:48:11.011161 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:48:11.011667 8789 external_mini_cluster.cc:1428] Setting key bf46658004a982d5d21700664f348ae3
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178890, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:11.023313 22720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.004578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:56069 (local address 127.8.149.126:36541)
0808 08:48:11.004817 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:11.004822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:11.005919 (+ 1097us) server_negotiation.cc:407] Connection header received
0808 08:48:11.007779 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:11.007784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:11.007856 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:11.007947 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:11.009500 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.010353 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.012150 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.012793 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.012908 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.017231 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:11.017236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:11.017239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:11.017270 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:11.020045 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.021026 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.021030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.021032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.021152 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.021622 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.021626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.021627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.021860 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:11.021967 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:11.022851 (+ 884us) server_negotiation.cc:299] Negotiation successful
0808 08:48:11.023015 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:48:11.024793 22931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.005041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:56069)
0808 08:48:11.005738 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:11.005775 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:11.007493 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:11.008244 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:11.008252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:11.008759 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:11.009323 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:11.009341 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.010505 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.010509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:11.011956 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:11.011968 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.013036 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.013044 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:11.013309 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.014118 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:11.014145 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:11.017013 (+ 2868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:11.020264 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:11.020276 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:11.020294 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:11.020909 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:11.021259 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:11.021266 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:11.021272 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:11.021516 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:11.021985 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:11.021995 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:11.022422 (+ 427us) client_negotiation.cc:769] Sending connection context
0808 08:48:11.022729 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 08:48:11.023371 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":267,"threads_started":1}
I20260808 08:48:11.026157 22929 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36541
I20260808 08:48:11.026489 22929 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:11.027382 22929 heartbeater.cc:511] Master 127.8.149.126:36541 requested a full tablet report, sending...
I20260808 08:48:11.028904 22407 ts_manager.cc:194] Registered new tserver with Master: 532dda75b18c4ec3add95759f05f409e (127.8.149.66:35781)
I20260808 08:48:11.029668 22407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:56069
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:48:11.071733 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:11.409931 22934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:11.410269 22934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:11.410450 22934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:11.418092 22934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:11.418210 22934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:11.418330 22934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:11.428229 22934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:11.429364 22934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:11.430631 22934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:11.444312 22942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:11.444361 22943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:11.444413 22945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:11.445894 22934 server_base.cc:1034] running on GCE node
I20260808 08:48:11.446638 22934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:11.447540 22934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:11.448753 22934 hybrid_clock.cc:648] HybridClock initialized: now 1786178891448696 us; error 39 us; skew 500 ppm
I20260808 08:48:11.449048 22934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178891, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:11.452216 22934 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:48:11.453661 22934 webserver.cc:460] Webserver started at http://127.8.149.67:34145/ using document root <none> and password file <none>
I20260808 08:48:11.454352 22934 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:11.454448 22934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:11.454692 22934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:11.457861 22934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "873e92898d7e483cb7b6b62ac20e4ba0"
format_stamp: "Formatted at 2026-08-08 08:48:11 on dist-test-slave-7vjv"
server_key: "c2dffd843933ac8105869dc31465aa17"
server_key_iv: "b46631dfb214d10a777696a98260ebb0"
server_key_version: "encryptionkey@0"
I20260808 08:48:11.458668 22934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "873e92898d7e483cb7b6b62ac20e4ba0"
format_stamp: "Formatted at 2026-08-08 08:48:11 on dist-test-slave-7vjv"
server_key: "c2dffd843933ac8105869dc31465aa17"
server_key_iv: "b46631dfb214d10a777696a98260ebb0"
server_key_version: "encryptionkey@0"
I20260808 08:48:11.463901 22934 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:48:11.467523 22955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:11.469008 22934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:48:11.469146 22934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "873e92898d7e483cb7b6b62ac20e4ba0"
format_stamp: "Formatted at 2026-08-08 08:48:11 on dist-test-slave-7vjv"
server_key: "c2dffd843933ac8105869dc31465aa17"
server_key_iv: "b46631dfb214d10a777696a98260ebb0"
server_key_version: "encryptionkey@0"
I20260808 08:48:11.469342 22934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:11.481495 22934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:11.486155 22934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:11.486413 22934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:11.487304 22934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:11.488739 22934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:11.488818 22934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:11.488915 22934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:11.488969 22934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:11.527292 22934 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:35435
I20260808 08:48:11.527405 23130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:35435 every 8 connection(s)
I20260808 08:48:11.527695 22718 heartbeater.cc:503] Master 127.8.149.126:36541 was elected leader, sending a full tablet report...
I20260808 08:48:11.528965 22934 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:11.535141 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 22934
I20260808 08:48:11.535331 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:48:11.535777 8789 external_mini_cluster.cc:1428] Setting key e8f5d7ae131986ab2facb7e93e4f803d
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178891, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:11.550567 23134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.531659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:41361 (local address 127.8.149.126:36541)
0808 08:48:11.532219 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:11.532226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:11.533272 (+ 1046us) server_negotiation.cc:407] Connection header received
0808 08:48:11.535144 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:11.535150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:11.535246 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:11.535393 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:11.537231 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.538070 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.539898 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.540400 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.540561 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.544297 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:11.544302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:11.544306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:11.544339 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:11.547139 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.547900 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.547913 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.547916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.548051 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.548589 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.548595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.548598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.548878 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:11.549044 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:11.549855 (+ 811us) server_negotiation.cc:299] Negotiation successful
0808 08:48:11.550089 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":283,"threads_started":1}
I20260808 08:48:11.551467 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.532349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:41361)
0808 08:48:11.533105 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:11.533149 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:11.534870 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:11.535629 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:11.535637 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:11.536286 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:11.537043 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:11.537073 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.538242 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.538248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:11.539727 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:11.539741 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.540650 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.540658 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:11.540930 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.541584 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:11.541609 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:11.544017 (+ 2408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:11.547294 (+ 3277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:11.547303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:11.547317 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:11.547757 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:11.548238 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:11.548244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:11.548248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:11.548453 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:11.549030 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:11.549039 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:11.549455 (+ 416us) client_negotiation.cc:769] Sending connection context
0808 08:48:11.549735 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 08:48:11.550238 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":271,"threads_started":1}
I20260808 08:48:11.552979 23132 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36541
I20260808 08:48:11.553241 23132 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:11.553856 23132 heartbeater.cc:511] Master 127.8.149.126:36541 requested a full tablet report, sending...
I20260808 08:48:11.555226 22407 ts_manager.cc:194] Registered new tserver with Master: 873e92898d7e483cb7b6b62ac20e4ba0 (127.8.149.67:35435)
I20260808 08:48:11.555964 22407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:41361
I20260808 08:48:11.562783 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
Entry for principal oryx/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab.
WARNING: no policy specified for oryx/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
Entry for principal oryx/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab.
WARNING: no policy specified for oryx/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
Entry for principal oryx/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab.
I20260808 08:48:11.708792 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 22503
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:48:11.725672 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.710200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.8.149.65:39101)
0808 08:48:11.710860 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:11.710867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:11.710897 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:48:11.711033 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:11.711042 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:11.711279 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:11.711420 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:11.712822 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.713837 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.715114 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.715731 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.715869 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.720010 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:11.720021 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:11.720034 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:11.720063 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:11.722945 (+ 2882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.723621 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.723628 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.723630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.723757 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.724202 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.724205 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.724207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.724548 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:11.724784 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:11.725053 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 08:48:11.725247 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":345,"threads_started":1}
I20260808 08:48:11.726961 22713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:11.808681 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 22503
I20260808 08:48:11.834412 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 22726
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:48:11.851207 23146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.835390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38928 (local address 127.8.149.66:35781)
0808 08:48:11.835931 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:11.835938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:11.835965 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:48:11.836028 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:11.836034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:11.836304 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:11.836446 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:11.837777 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.838750 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.840061 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.840731 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.840828 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.845375 (+ 4547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:11.845386 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:11.845411 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:11.845442 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:11.848599 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.849207 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.849214 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.849217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.849337 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.849664 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.849667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.849670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.849996 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:11.850214 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:11.850605 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:48:11.850796 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":276,"threads_started":1}
I20260808 08:48:11.852725 22922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:11.939811 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 22726
I20260808 08:48:11.960770 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 22934
Aug 08 08:48:11 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:48:11.978519 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:11.962096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33662 (local address 127.8.149.67:35435)
0808 08:48:11.962703 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:11.962710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:11.962737 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:48:11.962795 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:11.962801 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:11.963042 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:11.963172 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:11.964707 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.965756 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.967058 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:11.967588 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:11.967685 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:11.972513 (+ 4828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:11.972524 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:11.972537 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:11.972569 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:11.975580 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.976532 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.976544 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.976549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.976708 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:11.977127 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:11.977131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:11.977133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:11.977469 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:11.977691 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:11.977951 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 08:48:11.978182 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":306,"threads_started":1}
I20260808 08:48:11.979827 23125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:12.061185 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 22934
I20260808 08:48:12.086227 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 22346
I20260808 08:48:12.087487 22455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:12.193105 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 22346
I20260808 08:48:12.222234 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36541
--webserver_interface=127.8.149.126
--webserver_port=34205
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:36541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:12.551091 23158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:12.551386 23158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:12.551537 23158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:12.558709 23158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:12.558842 23158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:12.558956 23158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:12.559054 23158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:12.559128 23158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:12.568481 23158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:36541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=34205
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:12.569741 23158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:12.571022 23158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:12.582249 23166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:12.582288 23173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:12.582368 23167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:12.583520 23158 server_base.cc:1034] running on GCE node
I20260808 08:48:12.584270 23158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:12.585489 23158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:12.586681 23158 hybrid_clock.cc:648] HybridClock initialized: now 1786178892586644 us; error 23 us; skew 500 ppm
I20260808 08:48:12.587000 23158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:12 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178892, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:12.590126 23158 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:48:12.591351 23158 webserver.cc:460] Webserver started at http://127.8.149.126:34205/ using document root <none> and password file <none>
I20260808 08:48:12.592007 23158 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:12.592170 23158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:12.597222 23158 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:48:12.600049 23186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:12.601332 23158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:48:12.601508 23158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "b4728d2385214be6ab92a590fe38f983"
format_stamp: "Formatted at 2026-08-08 08:48:09 on dist-test-slave-7vjv"
server_key: "0074eef9519b323db8bf62e6d4bf0bae"
server_key_iv: "c49d1a63dacffaee6bc971831c4a71f6"
server_key_version: "encryptionkey@0"
I20260808 08:48:12.602388 23158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:12.615777 23158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:12.619867 23158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:12.620209 23158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:12.638379 23158 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:36541
I20260808 08:48:12.638401 23264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:36541 every 8 connection(s)
I20260808 08:48:12.639776 23158 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:12.646332 23266 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:48:12.646366 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 23158
I20260808 08:48:12.647166 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:39101
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:36541
--webserver_port=40105
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:48:12.649609 23266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Bootstrap starting.
I20260808 08:48:12.668196 23266 log.cc:824] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:12.676967 23266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:48:12.677498 23266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Bootstrap complete.
I20260808 08:48:12.686455 23266 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:12.687284 23266 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4728d2385214be6ab92a590fe38f983, State: Initialized, Role: FOLLOWER
I20260808 08:48:12.687969 23266 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:12.688258 23266 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:12.688405 23266 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:12.688601 23266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:48:12.692318 23266 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:12.692826 23266 leader_election.cc:302] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4728d2385214be6ab92a590fe38f983; no voters:
I20260808 08:48:12.693442 23266 leader_election.cc:288] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:48:12.693568 23271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:48:12.694747 23271 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [term 2 LEADER]: Becoming Leader. State: Replica: b4728d2385214be6ab92a590fe38f983, State: Running, Role: LEADER
I20260808 08:48:12.695392 23271 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } }
I20260808 08:48:12.695654 23266 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:12.698045 23277 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4728d2385214be6ab92a590fe38f983. Latest consensus state: current_term: 2 leader_uuid: "b4728d2385214be6ab92a590fe38f983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } } }
I20260808 08:48:12.698441 23277 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:12.699070 23272 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b4728d2385214be6ab92a590fe38f983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4728d2385214be6ab92a590fe38f983" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36541 } } }
I20260808 08:48:12.699375 23272 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:12.700819 23283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:12.707826 23283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:12.709636 23283 catalog_manager.cc:1259] Loaded cluster ID: 05b8edbb88774ffb9ab025a0d0f95c3a
I20260808 08:48:12.709817 23283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:12.714636 23283 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:12.716477 23283 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b4728d2385214be6ab92a590fe38f983: Loaded TSK: 0
I20260808 08:48:12.718405 23283 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:48:13.012243 23269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:13.012545 23269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:13.012702 23269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:13.019752 23269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:13.019876 23269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:13.020038 23269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:13.029204 23269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.65.keytab
--principal=oryx/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:39101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=40105
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:13.030411 23269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:13.031627 23269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:13.045078 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:13.045222 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:13.045997 23312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:13.047444 23269 server_base.cc:1034] running on GCE node
I20260808 08:48:13.048082 23269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:13.049060 23269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:13.050287 23269 hybrid_clock.cc:648] HybridClock initialized: now 1786178893050232 us; error 48 us; skew 500 ppm
I20260808 08:48:13.050593 23269 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178893, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:13.053782 23269 init.cc:377] Logged in from keytab as oryx/127.8.149.65@KRBTEST.COM (short username oryx)
I20260808 08:48:13.055346 23269 webserver.cc:460] Webserver started at http://127.8.149.65:40105/ using document root <none> and password file <none>
I20260808 08:48:13.056023 23269 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:13.056217 23269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:13.061470 23269 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:48:13.064152 23325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.065635 23269 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:48:13.065809 23269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "55f4ab783f8646d58e707b8beef09be0"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "4a626a0d62676dfd1db3194294f3281a"
server_key_iv: "6672509de6a085ca1c94fe2d943a8892"
server_key_version: "encryptionkey@0"
I20260808 08:48:13.066746 23269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:13.089221 23269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:13.093106 23269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:13.093364 23269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:13.094350 23269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:13.095701 23269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:13.095825 23269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.095959 23269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:13.096076 23269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.129504 23269 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:39101
I20260808 08:48:13.129594 23507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:39101 every 8 connection(s)
I20260808 08:48:13.131006 23269 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:13.135630 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 23269
I20260808 08:48:13.136435 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:35781
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:36541
--webserver_port=45475
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:48:13.484081 23515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:13.484437 23515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:13.484594 23515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:13.491384 23515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:13.491508 23515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:13.491670 23515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:13.501163 23515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.66.keytab
--principal=oryx/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:35781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=45475
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:13.502364 23515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:13.503562 23515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:13.521597 23530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:13.521633 23528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:13.521697 23532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:13.523051 23515 server_base.cc:1034] running on GCE node
I20260808 08:48:13.523679 23515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:13.524684 23515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:13.525985 23515 hybrid_clock.cc:648] HybridClock initialized: now 1786178893525917 us; error 75 us; skew 500 ppm
I20260808 08:48:13.526299 23515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178893, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:13.529518 23515 init.cc:377] Logged in from keytab as oryx/127.8.149.66@KRBTEST.COM (short username oryx)
I20260808 08:48:13.531081 23515 webserver.cc:460] Webserver started at http://127.8.149.66:45475/ using document root <none> and password file <none>
I20260808 08:48:13.531682 23515 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:13.531818 23515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:13.537307 23515 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:48:13.539964 23539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.541356 23515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:48:13.541519 23515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "532dda75b18c4ec3add95759f05f409e"
format_stamp: "Formatted at 2026-08-08 08:48:10 on dist-test-slave-7vjv"
server_key: "956c4faa2e83a8fff83d2a4c651ea0c9"
server_key_iv: "7f717b6186bbf1e3f13ae24df6e10ba0"
server_key_version: "encryptionkey@0"
I20260808 08:48:13.542471 23515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:13.566042 23515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:13.570066 23515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:13.570303 23515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:13.571388 23515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:13.572806 23515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:13.572894 23515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.573050 23515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:13.573127 23515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:13.622289 23515 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:35781
I20260808 08:48:13.622483 23723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:35781 every 8 connection(s)
I20260808 08:48:13.623736 23515 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:13.629396 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 23515
I20260808 08:48:13.630481 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:35435
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:36541
--webserver_port=34145
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:33907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:13 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:48:14.222543 23729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:14.222854 23729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:14.223053 23729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:14.230144 23729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:14.230288 23729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:14.230473 23729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:14.240058 23729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/krb5kdc/oryx_127.8.149.67.keytab
--principal=oryx/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:35435
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=34145
--tserver_master_addrs=127.8.149.126:36541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:14.241408 23729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:14.242890 23729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:14.259459 23738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:14.263113 23736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:14.263518 23741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:14.263993 23729 server_base.cc:1034] running on GCE node
I20260808 08:48:14.264706 23729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:14.265720 23729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:14.267022 23729 hybrid_clock.cc:648] HybridClock initialized: now 1786178894266968 us; error 39 us; skew 500 ppm
I20260808 08:48:14.267400 23729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178894, etypes {rep=17 tkt=17 ses=17}, oryx/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:14.270682 23729 init.cc:377] Logged in from keytab as oryx/127.8.149.67@KRBTEST.COM (short username oryx)
I20260808 08:48:14.273286 23729 webserver.cc:460] Webserver started at http://127.8.149.67:34145/ using document root <none> and password file <none>
I20260808 08:48:14.273960 23729 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:14.274123 23729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:14.279551 23729 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.002s
I20260808 08:48:14.282310 23753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:14.283716 23729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:48:14.283893 23729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "873e92898d7e483cb7b6b62ac20e4ba0"
format_stamp: "Formatted at 2026-08-08 08:48:11 on dist-test-slave-7vjv"
server_key: "c2dffd843933ac8105869dc31465aa17"
server_key_iv: "b46631dfb214d10a777696a98260ebb0"
server_key_version: "encryptionkey@0"
I20260808 08:48:14.285013 23729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:14.307505 23729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:14.312064 23729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:14.312414 23729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:14.313529 23729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:14.315222 23729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:14.315337 23729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:14.315445 23729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:14.315541 23729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:14.383824 23729 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:35435
I20260808 08:48:14.383983 23937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:35435 every 8 connection(s)
I20260808 08:48:14.386018 23729 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:14.389484 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 23729
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:14.423446 23940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.390668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36704 (local address 127.8.149.126:36541)
0808 08:48:14.397917 (+ 7249us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.397922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.404969 (+ 7047us) server_negotiation.cc:407] Connection header received
0808 08:48:14.405131 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.405136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.405219 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.405337 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.408035 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.409296 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.410551 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.411175 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.411290 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.415045 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:14.415056 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:14.415076 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:14.415136 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:14.419095 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:14.419888 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:14.419897 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:14.419905 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:14.420140 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:14.420586 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:14.420590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:14.420593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:14.421129 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:14.421384 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:14.422085 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 08:48:14.422503 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7125,"thread_start_us":5595,"threads_started":1}
W20260808 08:48:14.521879 23512 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.376s user 0.002s sys 0.017s
W20260808 08:48:14.524147 23511 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:13.134033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42253 (local address 127.8.149.126:36541)
0808 08:48:13.134778 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:13.134793 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:13.135027 (+ 234us) server_negotiation.cc:407] Connection header received
0808 08:48:13.138074 (+ 3047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:13.138086 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:13.138356 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:13.138612 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:13.140533 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.141674 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.143905 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.144851 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.145012 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.523662 (+1378650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:42253: BlockingRecv error: recv got EOF from 127.8.149.65:42253 (error 108)
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":262,"threads_started":1}
I20260808 08:48:14.525626 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:13.134089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:42253)
0808 08:48:13.134858 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:13.134901 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:13.137526 (+ 2625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:13.138805 (+ 1279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:13.138816 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:13.139529 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:13.140330 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:13.140357 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.141827 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.141836 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:13.143753 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:13.143768 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.145074 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.145083 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:13.145398 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:13.146181 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:13.146212 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.523214 (+1377002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":357,"threads_started":1}
W20260808 08:48:14.527706 23508 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:36541 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.149.126:36541: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:48:14.544761 23511 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:14.528997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:55531 (local address 127.8.149.126:36541)
0808 08:48:14.529297 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.529303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.529331 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:48:14.529489 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.529497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.529609 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.529764 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.531062 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.532715 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.535300 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.536206 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.536370 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.544377 (+ 8007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:55531: BlockingRecv error: recv got EOF from 127.8.149.65:55531 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:48:14.545567 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.528717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:55531)
0808 08:48:14.529082 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:14.529112 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:14.529319 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:14.529819 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:14.529828 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:14.530534 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:14.530856 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.530872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.532914 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.532923 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.535098 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.535118 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.536432 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.536442 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.536712 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.537786 (+ 1074us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:14.537820 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.545143 (+ 7323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191}
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:14.562520 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.546431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:41131)
0808 08:48:14.547372 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:14.547399 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:14.547654 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:14.548158 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:14.548165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:14.549024 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:14.549439 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.549454 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.551565 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.551573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.553710 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.553731 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.555052 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.555061 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.555320 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.556224 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:14.556257 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.562047 (+ 5790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":586,"threads_started":1}
W20260808 08:48:14.563546 23511 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:14.546991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:41131 (local address 127.8.149.126:36541)
0808 08:48:14.547394 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.547402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.547522 (+ 120us) server_negotiation.cc:407] Connection header received
0808 08:48:14.547821 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.547829 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.547948 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.548082 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.549718 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.551323 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.553908 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.554810 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.554990 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.563156 (+ 8166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:41131: BlockingRecv error: recv got EOF from 127.8.149.65:41131 (error 108)
Metrics: {"server-negotiator.queue_time_us":258}
W20260808 08:48:14.564487 23508 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:48:14.933305 23728 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.297s user 0.000s sys 0.018s
W20260808 08:48:14.935595 23727 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:13.627252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:58003 (local address 127.8.149.126:36541)
0808 08:48:13.627919 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:13.627929 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:13.628749 (+ 820us) server_negotiation.cc:407] Connection header received
0808 08:48:13.630667 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:13.630675 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:13.630768 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:13.630907 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:13.632490 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.633381 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.634845 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.635238 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.635369 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.935006 (+1299637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:58003: BlockingRecv error: recv got EOF from 127.8.149.66:58003 (error 108)
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":307,"threads_started":1}
I20260808 08:48:14.936460 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:13.627772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:58003)
0808 08:48:13.628592 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:13.628634 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:13.630370 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:13.631148 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:13.631163 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:13.631692 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:13.632318 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:13.632337 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.633551 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.633555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:13.634703 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:13.634715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:13.635464 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:13.635474 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:13.635687 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:13.636388 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:13.636417 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.934615 (+1298198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":366,"threads_started":1}
W20260808 08:48:14.937567 23724 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:36541 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.149.126:36541: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:14.962764 23950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.938447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:48147)
0808 08:48:14.939109 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:14.939131 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:14.939372 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:14.939985 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:14.939991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:14.940843 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:14.941206 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.941233 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.943020 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.943028 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.945411 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.945435 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.946761 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.946771 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.947157 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.955965 (+ 8808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:14.956002 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.962294 (+ 6292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":602,"threads_started":1}
W20260808 08:48:14.963079 23727 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:14.938821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:48147 (local address 127.8.149.126:36541)
0808 08:48:14.939062 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.939071 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.939225 (+ 154us) server_negotiation.cc:407] Connection header received
0808 08:48:14.939536 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.939543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.939649 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.939728 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.941549 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.942855 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.945603 (+ 2748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.946529 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.946691 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.962620 (+ 15929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:48147: BlockingRecv error: recv got EOF from 127.8.149.66:48147 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:14 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:48:14.980540 23727 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:14.964505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:49533 (local address 127.8.149.126:36541)
0808 08:48:14.964729 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.964737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.965784 (+ 1047us) server_negotiation.cc:407] Connection header received
0808 08:48:14.966171 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.966180 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.966286 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.966495 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.967869 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.969324 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.972180 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.972998 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.973156 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.980050 (+ 6894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:49533: BlockingRecv error: recv got EOF from 127.8.149.66:49533 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:48:14.981519 23950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.963938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:49533)
0808 08:48:14.965666 (+ 1728us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:14.965695 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:14.965899 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:14.966772 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:14.966780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:14.967366 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:14.967667 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.967681 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.969521 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.969530 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.971957 (+ 2427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.971978 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.973206 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.973215 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.973504 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.974392 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:14.974426 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:14.981117 (+ 6691us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1057}
W20260808 08:48:14.982089 23724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:48:15.512218 23946 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.101s user 0.012s sys 0.018s
W20260808 08:48:15.513633 23944 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:14.389672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:34957 (local address 127.8.149.126:36541)
0808 08:48:14.396562 (+ 6890us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:14.396571 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:14.397565 (+ 994us) server_negotiation.cc:407] Connection header received
0808 08:48:14.400721 (+ 3156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:14.400731 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:14.400846 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:14.400976 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:14.404250 (+ 3274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.405581 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.407499 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.408176 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.408314 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.513310 (+1104996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:34957: BlockingRecv error: recv got EOF from 127.8.149.67:34957 (error 108)
Metrics: {"server-negotiator.queue_time_us":6726,"thread_start_us":8007,"threads_started":1}
I20260808 08:48:15.514264 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:14.390702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:34957)
0808 08:48:14.397110 (+ 6408us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:14.397160 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:14.400095 (+ 2935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:14.401688 (+ 1593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:14.401704 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:14.402778 (+ 1074us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:14.403938 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.403971 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.405747 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.405752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.407332 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:14.407344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:14.408429 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:14.408437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:14.408722 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:14.410691 (+ 1969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:14.410723 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:15.513123 (+1102400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6118,"thread_start_us":5837,"threads_started":1}
W20260808 08:48:15.515239 23938 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:36541 (0 consecutive failures): Not authorized: Failed to ping master at 127.8.149.126:36541: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:15.525049 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:15.515843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:53601)
0808 08:48:15.516251 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:15.516269 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:15.516384 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:15.516841 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:15.516846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:15.517322 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:15.517488 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.517498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.518726 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.518731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.519682 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.519693 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.520524 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.520530 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.520707 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.521400 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:15.521420 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:15.524712 (+ 3292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222}
W20260808 08:48:15.525166 23944 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:15.515947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:53601 (local address 127.8.149.126:36541)
0808 08:48:15.516225 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:15.516231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:15.516318 (+ 87us) server_negotiation.cc:407] Connection header received
0808 08:48:15.516545 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:15.516549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:15.516641 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:15.516743 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:15.517648 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.518585 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.519838 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.520325 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.520478 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.524925 (+ 4447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:53601: BlockingRecv error: recv got EOF from 127.8.149.67:53601 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:15.533505 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:15.525749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:42875)
0808 08:48:15.525946 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:15.525961 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:15.526046 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:15.526319 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:15.526322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:15.526616 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:15.526755 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.526762 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.527646 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.527649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.528666 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.528678 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.529535 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.529541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.529772 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.530387 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:15.530403 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:15.533291 (+ 2888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:48:15.533706 23944 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:15.525851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42875 (local address 127.8.149.126:36541)
0808 08:48:15.526076 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:15.526079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:15.526094 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:48:15.526140 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:15.526143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:15.526187 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:15.526275 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:15.526867 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.527527 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.528795 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.529398 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.529518 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.533448 (+ 3930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:42875: BlockingRecv error: recv got EOF from 127.8.149.67:42875 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260808 08:48:15.533823 23938 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:15.573563 23951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:15.565100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:48489)
0808 08:48:15.565590 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:15.565605 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:15.565705 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:15.565966 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:15.565969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:15.566355 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:15.566527 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.566536 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.567502 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.567506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.568378 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.568389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.569088 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.569092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.569203 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.569815 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:15.569832 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:15.573238 (+ 3406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":304,"threads_started":1}
W20260808 08:48:15.573693 23944 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:15.565128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:48489 (local address 127.8.149.126:36541)
0808 08:48:15.565329 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:15.565338 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:15.565683 (+ 345us) server_negotiation.cc:407] Connection header received
0808 08:48:15.565791 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:15.565794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:15.565846 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:15.565919 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:15.566686 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.567385 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.568528 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.568951 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.569050 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.573435 (+ 4385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:48489: BlockingRecv error: recv got EOF from 127.8.149.65:48489 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:15 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:15.993026 23952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:15.982899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:54431)
0808 08:48:15.983478 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:15.983495 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:15.983654 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:15.983980 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:15.983983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:15.984431 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:15.984621 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.984630 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.985785 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.985791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.986672 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:15.986684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.987453 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.987459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:15.987631 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.988452 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:15.988490 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:15.992793 (+ 4303us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":337,"threads_started":1}
W20260808 08:48:15.993481 23944 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:15.982953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:54431 (local address 127.8.149.126:36541)
0808 08:48:15.983224 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:15.983235 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:15.983628 (+ 393us) server_negotiation.cc:407] Connection header received
0808 08:48:15.983765 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:15.983769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:15.983841 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:15.983941 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:15.984790 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.985616 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.986836 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:15.987259 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:15.987412 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:15.993035 (+ 5623us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:54431: BlockingRecv error: recv got EOF from 127.8.149.66:54431 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:16.543589 23955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:16.534410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:49181)
0808 08:48:16.535056 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:16.535073 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:16.535176 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:16.535503 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:16.535507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:16.535930 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:16.536084 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.536141 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.537220 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.537225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.538216 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.538226 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.538925 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.538929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.539031 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:16.539601 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:16.539624 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:16.543349 (+ 3725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":314,"threads_started":1}
W20260808 08:48:16.543824 23956 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:16.534641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:49181 (local address 127.8.149.126:36541)
0808 08:48:16.535128 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:16.535133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:16.535150 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:48:16.535281 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:16.535285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:16.535359 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:16.535460 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:16.536266 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.537088 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.538329 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.538766 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.538852 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:16.543577 (+ 4725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:49181: BlockingRecv error: recv got EOF from 127.8.149.67:49181 (error 108)
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":250,"threads_started":1}
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:16.583751 23958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:16.574508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:42181)
0808 08:48:16.575037 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:16.575055 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:16.575222 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:16.575700 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:16.575709 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:16.576455 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:16.576741 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.576756 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.577760 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.577763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.578666 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.578677 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.579387 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.579391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.579520 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:16.580122 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:16.580139 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:16.583512 (+ 3373us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":273,"threads_started":1}
W20260808 08:48:16.584118 23956 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:16.574584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42181 (local address 127.8.149.126:36541)
0808 08:48:16.574844 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:16.574853 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:16.575151 (+ 298us) server_negotiation.cc:407] Connection header received
0808 08:48:16.575412 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:16.575416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:16.575473 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:16.575611 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:16.576921 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.577626 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.578832 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.579250 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.579342 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:16.583728 (+ 4386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:42181: BlockingRecv error: recv got EOF from 127.8.149.65:42181 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:16 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:17.003641 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:16.994170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:39593)
0808 08:48:16.994644 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:16.994659 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:16.994766 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:16.995168 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:16.995173 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:16.995727 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:16.995972 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.996008 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.997584 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.997589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.998468 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:16.998477 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.999170 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.999173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:16.999276 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:16.999909 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:16.999926 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:17.003326 (+ 3400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":257,"threads_started":1}
W20260808 08:48:17.003780 23956 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:16.994172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:39593 (local address 127.8.149.126:36541)
0808 08:48:16.994388 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:16.994397 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:16.994740 (+ 343us) server_negotiation.cc:407] Connection header received
0808 08:48:16.994899 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:16.994903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:16.994970 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:16.995104 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:16.996237 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.997431 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.998589 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:16.999031 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:16.999145 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:17.003544 (+ 4399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:39593: BlockingRecv error: recv got EOF from 127.8.149.66:39593 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 08:48:17 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:17 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:17.553627 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:17.544601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:37649)
0808 08:48:17.545151 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:17.545167 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:17.545264 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:17.545810 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:17.545834 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:17.546307 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:17.546494 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:17.546503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.547530 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.547534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:17.548524 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:17.548536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.549143 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.549148 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:17.549262 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:17.549831 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:17.549854 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:17.553378 (+ 3524us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":312,"threads_started":1}
W20260808 08:48:17.553788 23963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:17.544738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:37649 (local address 127.8.149.126:36541)
0808 08:48:17.545478 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:17.545482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:17.545504 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:48:17.545566 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:17.545573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:17.545674 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:17.545759 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:17.546616 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.547419 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.548643 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.549013 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.549100 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:17.553547 (+ 4447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:37649: BlockingRecv error: recv got EOF from 127.8.149.67:37649 (error 108)
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":492,"threads_started":1}
Aug 08 08:48:17 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:17 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:17.593044 23964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:17.584786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:55275)
0808 08:48:17.585318 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:17.585334 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:17.585447 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:17.585714 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:17.585717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:17.586062 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:17.586236 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:17.586244 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.587195 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.587199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:17.588079 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:17.588140 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.588744 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.588748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:17.588901 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:17.589414 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:17.589430 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:17.592811 (+ 3381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":290,"threads_started":1}
W20260808 08:48:17.593186 23963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:17.584832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:55275 (local address 127.8.149.126:36541)
0808 08:48:17.584981 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:17.584985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:17.585411 (+ 426us) server_negotiation.cc:407] Connection header received
0808 08:48:17.585537 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:17.585540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:17.585593 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:17.585666 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:17.586350 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.587069 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.588250 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:17.588632 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:17.588715 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:17.592971 (+ 4256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:55275: BlockingRecv error: recv got EOF from 127.8.149.65:55275 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:18.013883 23965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:18.004762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:51515)
0808 08:48:18.005327 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:18.005344 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:18.005512 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:18.005863 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:18.005868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:18.006377 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:18.006553 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.006563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.007579 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.007585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.008546 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.008558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.009300 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.009306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.009495 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.010037 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:18.010054 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:18.013636 (+ 3582us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":315,"threads_started":1}
W20260808 08:48:18.014077 23963 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:18.004791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:51515 (local address 127.8.149.126:36541)
0808 08:48:18.005021 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:18.005028 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:18.005442 (+ 414us) server_negotiation.cc:407] Connection header received
0808 08:48:18.005649 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:18.005655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:18.005723 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:18.005829 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:18.006703 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.007436 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.008683 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.009137 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.009287 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.013803 (+ 4516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:51515: BlockingRecv error: recv got EOF from 127.8.149.66:51515 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:18.564144 23966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:18.554816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:54357)
0808 08:48:18.555683 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:18.555703 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:18.555830 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:18.556289 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:18.556296 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:18.556827 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:18.556985 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.556995 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.558025 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.558029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.558933 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.558943 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.559623 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.559628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.559745 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.560389 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:18.560406 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:18.563857 (+ 3451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":300,"threads_started":1}
W20260808 08:48:18.564406 23967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:18.554997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:54357 (local address 127.8.149.126:36541)
0808 08:48:18.555728 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:18.555735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:18.555763 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:48:18.555980 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:18.555985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:18.556063 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:18.556221 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:18.557133 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.557890 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.559072 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.559490 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.559597 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.564070 (+ 4473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:54357: BlockingRecv error: recv got EOF from 127.8.149.67:54357 (error 108)
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":457,"threads_started":1}
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:18 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:18.603931 23969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:18.593989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:42101)
0808 08:48:18.594533 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:18.594549 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:18.594655 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:18.594959 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:18.594962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:18.595346 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:18.595578 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.595589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.596692 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.596695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.597965 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:18.597980 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.598693 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.598698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:18.598821 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.599494 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:18.599513 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:18.603512 (+ 3999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":292,"threads_started":1}
W20260808 08:48:18.603972 23967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:18.594057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42101 (local address 127.8.149.126:36541)
0808 08:48:18.594283 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:18.594287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:18.594618 (+ 331us) server_negotiation.cc:407] Connection header received
0808 08:48:18.594745 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:18.594749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:18.594806 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:18.594885 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:18.595707 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.596482 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.598108 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:18.598529 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:18.598664 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:18.603720 (+ 5056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:42101: BlockingRecv error: recv got EOF from 127.8.149.65:42101 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:19.023751 23970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:19.014939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:43481)
0808 08:48:19.015449 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:19.015464 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:19.015588 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:19.015873 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:19.015876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:19.016335 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:19.016493 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.016501 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.017471 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.017474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.018700 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.018715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.019481 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.019485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.019618 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.020218 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:19.020235 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:19.023502 (+ 3267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":281,"threads_started":1}
W20260808 08:48:19.024096 23967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:19.014993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:43481 (local address 127.8.149.126:36541)
0808 08:48:19.015218 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:19.015225 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:19.015566 (+ 341us) server_negotiation.cc:407] Connection header received
0808 08:48:19.015681 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:19.015685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:19.015757 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:19.015832 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:19.016608 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.017329 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.018844 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.019351 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.019447 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.023730 (+ 4283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:43481: BlockingRecv error: recv got EOF from 127.8.149.66:43481 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:19.575274 23971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:19.565235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:36593)
0808 08:48:19.565758 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:19.565777 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:19.565900 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:19.566391 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:19.566395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:19.566839 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:19.567048 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.567077 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.568328 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.568332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.569408 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.569421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.570155 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.570160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.570292 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.571047 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:19.571075 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:19.574991 (+ 3916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":295,"threads_started":1}
W20260808 08:48:19.575443 23972 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:19.565322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:36593 (local address 127.8.149.126:36541)
0808 08:48:19.566109 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:19.566114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:19.566129 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:48:19.566171 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:19.566174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:19.566230 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:19.566316 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:19.567294 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.568157 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.569558 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.570010 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.570102 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.575181 (+ 5079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:36593: BlockingRecv error: recv got EOF from 127.8.149.67:36593 (error 108)
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":523,"threads_started":1}
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:19 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:19.614748 23973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:19.605038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:59385)
0808 08:48:19.605700 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:19.605722 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:19.605956 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:19.606334 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:19.606340 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:19.606849 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:19.607050 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.607060 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.608313 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.608317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.609301 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:19.609314 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.610036 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.610041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:19.610182 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.610871 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:19.610892 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:19.614496 (+ 3604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":391,"threads_started":1}
W20260808 08:48:19.614838 23972 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:19.605123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:59385 (local address 127.8.149.126:36541)
0808 08:48:19.605661 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:19.605681 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:19.605820 (+ 139us) server_negotiation.cc:407] Connection header received
0808 08:48:19.606065 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:19.606072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:19.606156 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:19.606295 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:19.607213 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.608143 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.609459 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:19.609864 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:19.609964 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:19.614649 (+ 4685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:59385: BlockingRecv error: recv got EOF from 127.8.149.65:59385 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:20.041878 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:20.024763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:51717)
0808 08:48:20.025410 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:20.025428 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:20.025552 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:20.025959 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:20.025963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:20.026451 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:20.026674 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.026691 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.028075 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.028079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.029010 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.029021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.029668 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.029672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.029783 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.037669 (+ 7886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:20.037686 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:20.041619 (+ 3933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":351,"threads_started":1}
W20260808 08:48:20.042058 23972 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:20.024964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:51717 (local address 127.8.149.126:36541)
0808 08:48:20.025186 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:20.025190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:20.025509 (+ 319us) server_negotiation.cc:407] Connection header received
0808 08:48:20.025687 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:20.025691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:20.025766 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:20.025849 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:20.026859 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.027942 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.029150 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.029552 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.029638 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.041826 (+ 12188us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:51717: BlockingRecv error: recv got EOF from 127.8.149.66:51717 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:20.586041 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:20.576329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:50097)
0808 08:48:20.577008 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:20.577031 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:20.577172 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:20.577646 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:20.577651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:20.578309 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:20.578524 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.578535 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.579490 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.579495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.580478 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.580490 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.581275 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.581280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.581418 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.582079 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:20.582096 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:20.585694 (+ 3598us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":312,"threads_started":1}
W20260808 08:48:20.586210 23980 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:20.576444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:50097 (local address 127.8.149.126:36541)
0808 08:48:20.577161 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:20.577165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:20.577182 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:48:20.577305 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:20.577310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:20.577456 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:20.577579 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:20.578655 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.579347 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.580639 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.581115 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.581232 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.585934 (+ 4702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:50097: BlockingRecv error: recv got EOF from 127.8.149.67:50097 (error 108)
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":509,"threads_started":1}
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:20 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:20.624243 23981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:20.615703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:36557)
0808 08:48:20.616244 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:20.616261 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:20.616366 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:20.616613 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:20.616616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:20.617039 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:20.617192 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.617201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.618130 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.618134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.619070 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:20.619082 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.619719 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.619723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:20.619840 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.620436 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:20.620452 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:20.623915 (+ 3463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":289,"threads_started":1}
W20260808 08:48:20.624404 23980 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:20.615720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:36557 (local address 127.8.149.126:36541)
0808 08:48:20.615910 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:20.615915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:20.616333 (+ 418us) server_negotiation.cc:407] Connection header received
0808 08:48:20.616443 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:20.616446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:20.616498 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:20.616569 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:20.617307 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.618001 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.619191 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:20.619570 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:20.619665 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:20.624171 (+ 4506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:36557: BlockingRecv error: recv got EOF from 127.8.149.65:36557 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:21.052685 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:21.042821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:41565)
0808 08:48:21.043385 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:21.043403 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:21.043516 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:21.043842 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:21.043845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:21.044357 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:21.044545 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.044555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.045592 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.045595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.046809 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.046822 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.047505 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.047512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.047692 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.048505 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:21.048528 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:21.052428 (+ 3900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":306,"threads_started":1}
W20260808 08:48:21.052824 23980 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:21.042847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:41565 (local address 127.8.149.126:36541)
0808 08:48:21.043089 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:21.043099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:21.043477 (+ 378us) server_negotiation.cc:407] Connection header received
0808 08:48:21.043615 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:21.043618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:21.043689 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:21.043782 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:21.044669 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.045484 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.046943 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.047335 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.047417 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.052599 (+ 5182us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:41565: BlockingRecv error: recv got EOF from 127.8.149.66:41565 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:21.597856 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:21.587150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:52863)
0808 08:48:21.587716 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:21.587739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:21.587862 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:21.588495 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:21.588498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:21.589060 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:21.589247 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.589257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.590596 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.590601 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.591648 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.591661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.592503 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.592507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.592641 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.593312 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:21.593331 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:21.597493 (+ 4162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":283,"threads_started":1}
W20260808 08:48:21.598107 23985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:21.587256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:52863 (local address 127.8.149.126:36541)
0808 08:48:21.588165 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:21.588170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:21.588189 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:48:21.588239 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:21.588243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:21.588314 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:21.588422 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:21.589398 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.590400 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.591812 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.592342 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.592457 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.597785 (+ 5328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:52863: BlockingRecv error: recv got EOF from 127.8.149.67:52863 (error 108)
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":652,"threads_started":1}
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:21 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:21.634290 23987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:21.625402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:44073)
0808 08:48:21.626121 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:21.626140 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:21.626265 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:21.626669 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:21.626673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:21.627109 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:21.627282 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.627291 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.628357 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.628361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.629358 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:21.629370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.630075 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.630078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:21.630177 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.630703 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:21.630718 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:21.634013 (+ 3295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":341,"threads_started":1}
W20260808 08:48:21.634444 23985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:21.625474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:44073 (local address 127.8.149.126:36541)
0808 08:48:21.625651 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:21.625657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:21.626235 (+ 578us) server_negotiation.cc:407] Connection header received
0808 08:48:21.626359 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:21.626363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:21.626450 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:21.626533 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:21.627432 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.628217 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.629499 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:21.629946 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:21.630037 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:21.634235 (+ 4198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:44073: BlockingRecv error: recv got EOF from 127.8.149.65:44073 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:22.062929 23989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:22.053735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:55315)
0808 08:48:22.054375 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:22.054392 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:22.054518 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:22.054926 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:22.054931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:22.055464 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:22.055679 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.055692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.056962 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.056966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.057913 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.057924 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.058591 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.058595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.058703 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.059271 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:22.059287 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:22.062615 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":320,"threads_started":1}
W20260808 08:48:22.063087 23985 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:22.053834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:55315 (local address 127.8.149.126:36541)
0808 08:48:22.054082 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:22.054087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:22.054485 (+ 398us) server_negotiation.cc:407] Connection header received
0808 08:48:22.054631 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:22.054635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:22.054699 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:22.054804 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:22.055856 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.056827 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.058036 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.058445 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.058555 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.062832 (+ 4277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:55315: BlockingRecv error: recv got EOF from 127.8.149.66:55315 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:22.607352 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:22.598738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:32877)
0808 08:48:22.599263 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:22.599278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:22.599376 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:22.599870 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:22.599874 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:22.600284 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:22.600451 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.600459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.601427 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.601430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.602368 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.602378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.603059 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.603063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.603170 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.603816 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:22.603832 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:22.607133 (+ 3301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":231,"threads_started":1}
W20260808 08:48:22.607575 23993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:22.598785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:32877 (local address 127.8.149.126:36541)
0808 08:48:22.599593 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:22.599597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:22.599626 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:48:22.599667 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:22.599670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:22.599736 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:22.599819 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:22.600590 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.601311 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.602497 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.602917 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.603009 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.607318 (+ 4309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:32877: BlockingRecv error: recv got EOF from 127.8.149.67:32877 (error 108)
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":597,"threads_started":1}
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:22 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:22.645409 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:22.635155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:47459)
0808 08:48:22.635729 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:22.635747 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:22.635952 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:22.636359 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:22.636365 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:22.636852 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:22.637050 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.637062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.638109 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.638115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.639130 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:22.639171 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.640133 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.640143 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:22.640318 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.641038 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:22.641057 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:22.645081 (+ 4024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":251,"threads_started":1}
W20260808 08:48:22.645532 23993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:22.635418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:47459 (local address 127.8.149.126:36541)
0808 08:48:22.635626 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:22.635633 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:22.635835 (+ 202us) server_negotiation.cc:407] Connection header received
0808 08:48:22.636112 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:22.636118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:22.636197 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:22.636314 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:22.637217 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.637955 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.639318 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:22.639885 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:22.640028 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:22.645234 (+ 5206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:47459: BlockingRecv error: recv got EOF from 127.8.149.65:47459 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:23.073886 23995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:23.063912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:39327)
0808 08:48:23.064537 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:23.064553 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:23.064667 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:23.064979 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:23.064983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:23.065588 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:23.065837 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.065865 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.067296 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.067299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.068183 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.068194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.069012 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.069015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.069119 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.069719 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:23.069734 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:23.073521 (+ 3787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":349,"threads_started":1}
W20260808 08:48:23.074026 23993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:23.063948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:39327 (local address 127.8.149.126:36541)
0808 08:48:23.064268 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:23.064272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:23.064649 (+ 377us) server_negotiation.cc:407] Connection header received
0808 08:48:23.064766 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:23.064770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:23.064846 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:23.064931 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:23.066009 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.067164 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.068304 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.068853 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.068945 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.073725 (+ 4780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:39327: BlockingRecv error: recv got EOF from 127.8.149.66:39327 (error 108)
Metrics: {"server-negotiator.queue_time_us":204}
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:23.617843 23996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:23.608367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:36187)
0808 08:48:23.608963 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:23.608981 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:23.609110 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:23.609441 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:23.609445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:23.609880 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:23.610065 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.610074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.611060 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.611064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.612038 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.612050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.612802 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.612806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.612952 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.613574 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:23.613591 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:23.617621 (+ 4030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":264,"threads_started":1}
W20260808 08:48:23.618221 23997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:23.608474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:36187 (local address 127.8.149.126:36541)
0808 08:48:23.608968 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:23.608973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:23.609075 (+ 102us) server_negotiation.cc:407] Connection header received
0808 08:48:23.609213 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:23.609216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:23.609286 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:23.609389 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:23.610193 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.610915 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.612195 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.612611 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.612705 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.617830 (+ 5125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:36187: BlockingRecv error: recv got EOF from 127.8.149.67:36187 (error 108)
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":263,"threads_started":1}
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:23 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:23.655057 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:23.646281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:39921)
0808 08:48:23.646743 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:23.646797 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:23.646941 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:23.647241 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:23.647245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:23.647690 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:23.647860 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.647872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.648857 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.648861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.649783 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:23.649795 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.650441 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.650445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:23.650567 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.651194 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:23.651211 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:23.654824 (+ 3613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":236,"threads_started":1}
W20260808 08:48:23.655094 23997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:23.646368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:39921 (local address 127.8.149.126:36541)
0808 08:48:23.646581 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:23.646587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:23.646874 (+ 287us) server_negotiation.cc:407] Connection header received
0808 08:48:23.647041 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:23.647044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:23.647098 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:23.647189 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:23.647994 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.648720 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.649915 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:23.650300 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:23.650398 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:23.654958 (+ 4560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:39921: BlockingRecv error: recv got EOF from 127.8.149.65:39921 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:24.083977 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:24.074865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:44471)
0808 08:48:24.075411 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:24.075442 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:24.075597 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:24.075947 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:24.075952 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:24.076446 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:24.076592 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.076600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.077612 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.077618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.078545 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.078555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.079279 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.079285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.079466 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.080055 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:24.080075 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:24.083671 (+ 3596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":303,"threads_started":1}
W20260808 08:48:24.084252 23997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:24.074946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:44471 (local address 127.8.149.126:36541)
0808 08:48:24.075186 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:24.075194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:24.075528 (+ 334us) server_negotiation.cc:407] Connection header received
0808 08:48:24.075718 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:24.075725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:24.075809 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:24.075909 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:24.076737 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.077469 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.078679 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.079131 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.079261 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.083899 (+ 4638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:44471: BlockingRecv error: recv got EOF from 127.8.149.66:44471 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:24.628319 24001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:24.618825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:37459)
0808 08:48:24.619376 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:24.619396 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:24.619512 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:24.619951 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:24.619955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:24.620421 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:24.620586 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.620595 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.621543 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.621546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.622628 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.622639 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.623621 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.623629 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.623793 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.624420 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:24.624441 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:24.628057 (+ 3616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":269,"threads_started":1}
W20260808 08:48:24.628516 24002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:24.618915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:37459 (local address 127.8.149.126:36541)
0808 08:48:24.619648 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:24.619652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:24.619667 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:48:24.619708 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:24.619712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:24.619766 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:24.619850 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:24.620711 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.621435 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.622758 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.623446 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.623543 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.628289 (+ 4746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:37459: BlockingRecv error: recv got EOF from 127.8.149.67:37459 (error 108)
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":530,"threads_started":1}
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:24 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:24.664759 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:24.655975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:44801)
0808 08:48:24.656456 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:24.656472 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:24.656613 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:24.656988 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:24.656993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:24.657386 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:24.657537 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.657546 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.658579 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.658586 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.659482 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:24.659493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.660210 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.660217 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:24.660405 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.661019 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:24.661037 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:24.664396 (+ 3359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":250,"threads_started":1}
W20260808 08:48:24.664819 24002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:24.656078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:44801 (local address 127.8.149.126:36541)
0808 08:48:24.656284 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:24.656291 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:24.656547 (+ 256us) server_negotiation.cc:407] Connection header received
0808 08:48:24.656755 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:24.656759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:24.656816 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:24.656908 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:24.657679 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.658427 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.659642 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:24.660032 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:24.660179 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:24.664591 (+ 4412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:44801: BlockingRecv error: recv got EOF from 127.8.149.65:44801 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:25.096823 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:25.085052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:49547)
0808 08:48:25.085628 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:25.085647 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:25.085760 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:25.086039 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:25.086042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:25.086416 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:25.086589 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.086597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.087511 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.087515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.088664 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.088677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.089503 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.089508 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.089659 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.092656 (+ 2997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:25.092673 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:25.096453 (+ 3780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":338,"threads_started":1}
W20260808 08:48:25.096897 24002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:25.085166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:49547 (local address 127.8.149.126:36541)
0808 08:48:25.085506 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:25.085512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:25.085721 (+ 209us) server_negotiation.cc:407] Connection header received
0808 08:48:25.085862 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:25.085865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:25.085924 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:25.086001 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:25.086705 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.087394 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.088778 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.089367 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.089468 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.096661 (+ 7193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:49547: BlockingRecv error: recv got EOF from 127.8.149.66:49547 (error 108)
Metrics: {"server-negotiator.queue_time_us":187}
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:25.638147 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:25.629236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:45841)
0808 08:48:25.629798 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:25.629813 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:25.629946 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:25.630277 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:25.630283 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:25.630712 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:25.630857 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.630900 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.631945 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.631950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.632900 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.632910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.633617 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.633622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.633790 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.634424 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:25.634445 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:25.637780 (+ 3335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":308,"threads_started":1}
W20260808 08:48:25.638311 24007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:25.629340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:45841 (local address 127.8.149.126:36541)
0808 08:48:25.629846 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:25.629850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:25.629900 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:48:25.630048 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:25.630052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:25.630121 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:25.630230 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:25.631045 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.631804 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.633048 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.633459 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.633603 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.637989 (+ 4386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:45841: BlockingRecv error: recv got EOF from 127.8.149.67:45841 (error 108)
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":258,"threads_started":1}
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:25 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:25.675029 24013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:25.665843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:48725)
0808 08:48:25.666385 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:25.666418 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:25.666547 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:25.667007 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:25.667014 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:25.667438 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:25.667627 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.667636 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.668775 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.668780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.669670 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:25.669681 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.670432 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.670440 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:25.670590 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.671223 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:25.671239 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:25.674814 (+ 3575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":303,"threads_started":1}
W20260808 08:48:25.675231 24007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:25.665927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:48725 (local address 127.8.149.126:36541)
0808 08:48:25.666531 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:25.666539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:25.666562 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:48:25.666803 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:25.666807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:25.666862 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:25.666971 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:25.667774 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.668649 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.669808 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:25.670258 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:25.670383 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:25.675024 (+ 4641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:48725: BlockingRecv error: recv got EOF from 127.8.149.65:48725 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:26.107847 24014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:26.097920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:42627)
0808 08:48:26.098534 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:26.098553 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:26.098681 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:26.099019 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:26.099023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:26.099483 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:26.099714 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.099724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.101207 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.101212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.102195 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.102208 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.102954 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.102959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.103086 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.103627 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:26.103644 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:26.107498 (+ 3854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":336,"threads_started":1}
W20260808 08:48:26.108039 24007 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:26.097954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:42627 (local address 127.8.149.126:36541)
0808 08:48:26.098134 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:26.098138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:26.098634 (+ 496us) server_negotiation.cc:407] Connection header received
0808 08:48:26.098781 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:26.098785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:26.098862 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:26.098956 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:26.099895 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.101026 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.102353 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.102772 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.102912 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.107689 (+ 4777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:42627: BlockingRecv error: recv got EOF from 127.8.149.66:42627 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:26.649188 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:26.639145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:51277)
0808 08:48:26.639782 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:26.639806 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:26.639980 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:26.640382 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:26.640385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:26.640794 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:26.640997 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.641007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.642401 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.642406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.643470 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.643482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.644422 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.644425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.644543 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.645225 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:26.645240 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:26.648986 (+ 3746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":273,"threads_started":1}
W20260808 08:48:26.649601 24017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:26.639182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:51277 (local address 127.8.149.126:36541)
0808 08:48:26.640017 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:26.640027 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:26.640046 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:48:26.640133 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:26.640138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:26.640235 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:26.640360 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:26.641126 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.642277 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.643600 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.644305 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.644413 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.649215 (+ 4802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:51277: BlockingRecv error: recv got EOF from 127.8.149.67:51277 (error 108)
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":594,"threads_started":1}
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:26 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:26.685039 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:26.675885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:46417)
0808 08:48:26.676486 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:26.676509 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:26.676645 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:26.677039 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:26.677044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:26.677617 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:26.677894 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.677908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.678831 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.678835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.679800 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:26.679812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.680506 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.680510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:26.680634 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.681158 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:26.681174 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:26.684760 (+ 3586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":356,"threads_started":1}
W20260808 08:48:26.685115 24017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:26.675918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:46417 (local address 127.8.149.126:36541)
0808 08:48:26.676086 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:26.676131 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:26.676596 (+ 465us) server_negotiation.cc:407] Connection header received
0808 08:48:26.676768 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:26.676772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:26.676851 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:26.676968 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:26.678040 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.678711 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.679925 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:26.680373 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:26.680485 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:26.684946 (+ 4461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:46417: BlockingRecv error: recv got EOF from 127.8.149.65:46417 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:27.118350 24019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:27.109227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:47619)
0808 08:48:27.109760 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:27.109776 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:27.109948 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:27.110292 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:27.110297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:27.110710 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:27.110875 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.110884 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.111985 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.111992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.112947 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.112958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.113773 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.113779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.113964 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.114601 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:27.114619 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:27.118117 (+ 3498us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":300,"threads_started":1}
W20260808 08:48:27.118563 24017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:27.109252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:47619 (local address 127.8.149.126:36541)
0808 08:48:27.109436 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:27.109444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:27.109874 (+ 430us) server_negotiation.cc:407] Connection header received
0808 08:48:27.110062 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:27.110071 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:27.110141 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:27.110235 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:27.111075 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.111835 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.113079 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.113599 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.113727 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.118311 (+ 4584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:47619: BlockingRecv error: recv got EOF from 127.8.149.66:47619 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:27.659461 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:27.650347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:40171)
0808 08:48:27.650995 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:27.651012 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:27.651126 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:27.651418 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:27.651421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:27.651834 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:27.652037 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.652047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.653096 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.653100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.654098 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.654112 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.654781 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.654785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.654943 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.655482 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:27.655498 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:27.659105 (+ 3607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":331,"threads_started":1}
W20260808 08:48:27.659638 24021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:27.650429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:40171 (local address 127.8.149.126:36541)
0808 08:48:27.650979 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:27.650983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:27.651083 (+ 100us) server_negotiation.cc:407] Connection header received
0808 08:48:27.651219 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:27.651223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:27.651287 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:27.651373 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:27.652197 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.652954 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.654231 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.654665 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.654754 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.659402 (+ 4648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:40171: BlockingRecv error: recv got EOF from 127.8.149.67:40171 (error 108)
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":291,"threads_started":1}
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:27 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:27.695168 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:27.685960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:59627)
0808 08:48:27.686376 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:27.686392 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:27.686499 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:27.686721 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:27.686724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:27.687166 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:27.687318 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.687326 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.688516 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.688520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.689510 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:27.689522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.690260 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.690264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:27.690383 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.690998 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:27.691015 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:27.694744 (+ 3729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":237,"threads_started":1}
W20260808 08:48:27.695163 24021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:27.686009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:59627 (local address 127.8.149.126:36541)
0808 08:48:27.686217 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:27.686222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:27.686465 (+ 243us) server_negotiation.cc:407] Connection header received
0808 08:48:27.686572 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:27.686575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:27.686631 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:27.686703 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:27.687497 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.688383 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.689653 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:27.690124 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:27.690216 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:27.694928 (+ 4712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:59627: BlockingRecv error: recv got EOF from 127.8.149.65:59627 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:28.133836 24024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:28.119403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:53005)
0808 08:48:28.119893 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:28.119936 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:28.120052 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:28.120445 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:28.120448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:28.120903 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:28.121088 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.121097 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.122255 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.122259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.123202 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.123214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.123951 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.123955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.124083 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.129762 (+ 5679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:28.129781 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:28.133495 (+ 3714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":276,"threads_started":1}
W20260808 08:48:28.133982 24021 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:28.119514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:53005 (local address 127.8.149.126:36541)
0808 08:48:28.119758 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:28.119765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:28.120023 (+ 258us) server_negotiation.cc:407] Connection header received
0808 08:48:28.120200 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:28.120205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:28.120305 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:28.120400 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:28.121233 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.122102 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.123356 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.123795 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.123897 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.133714 (+ 9817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:53005: BlockingRecv error: recv got EOF from 127.8.149.66:53005 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.67@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:28.669728 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:28.660376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.67:48281)
0808 08:48:28.660873 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:28.660890 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:28.661030 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:28.661363 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:28.661370 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:28.661806 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:28.661991 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.662001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.663166 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.663170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.664187 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.664198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.665125 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.665130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.665300 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.666049 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:28.666067 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:28.669485 (+ 3418us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":252,"threads_started":1}
W20260808 08:48:28.670143 24026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:28.660422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:48281 (local address 127.8.149.126:36541)
0808 08:48:28.660884 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:28.660890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:28.660989 (+ 99us) server_negotiation.cc:407] Connection header received
0808 08:48:28.661121 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:28.661124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:28.661183 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:28.661271 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:28.662135 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.663010 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.664328 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.664980 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.665107 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.669884 (+ 4777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.67:48281: BlockingRecv error: recv got EOF from 127.8.149.67:48281 (error 108)
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":269,"threads_started":1}
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:28 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.65@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:28.705334 24027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:28.696397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.65:37731)
0808 08:48:28.696971 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:28.696987 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:28.697132 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:28.697491 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:28.697499 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:28.697889 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:28.698059 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.698069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.699074 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.699080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.700073 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:28.700085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.700841 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.700847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:28.701048 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.701660 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:28.701678 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:28.704979 (+ 3301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":311,"threads_started":1}
W20260808 08:48:28.705410 24026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:28.696474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:37731 (local address 127.8.149.126:36541)
0808 08:48:28.696763 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:28.696770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:28.697066 (+ 296us) server_negotiation.cc:407] Connection header received
0808 08:48:28.697272 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:28.697277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:28.697342 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:28.697455 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:28.698198 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.698932 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.700257 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:28.700666 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:28.700823 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:28.705155 (+ 4332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.65:37731: BlockingRecv error: recv got EOF from 127.8.149.65:37731 (error 108)
Metrics: {"server-negotiator.queue_time_us":156}
Aug 08 08:48:29 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:48:29 dist-test-slave-7vjv krb5kdc[22331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.8.149.66@KRBTEST.COM for oryx/127.8.149.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:48:29.144239 24029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:29.135122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36541 (local address 127.8.149.66:57591)
0808 08:48:29.135619 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:29.135642 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:29.135752 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:29.136035 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:29.136038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:29.136430 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:29.136637 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:29.136647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.137630 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.137634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:29.138532 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:29.138543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.139176 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.139180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:29.139317 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:29.139990 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:29.140006 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:29.143842 (+ 3836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.8.149.126:36541: Server oryx/127.8.149.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":253,"threads_started":1}
W20260808 08:48:29.144330 24026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:29.135224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:57591 (local address 127.8.149.126:36541)
0808 08:48:29.135381 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:29.135385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:29.135712 (+ 327us) server_negotiation.cc:407] Connection header received
0808 08:48:29.135843 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:29.135846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:29.135917 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:29.135995 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:29.136761 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.137502 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.138648 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.139069 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.139156 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:29.144076 (+ 4920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.8.149.66:57591: BlockingRecv error: recv got EOF from 127.8.149.66:57591 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:48:29.390863 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23269
I20260808 08:48:29.404451 24031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:29.391984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60068 (local address 127.8.149.65:39101)
0808 08:48:29.392726 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:29.392734 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:29.392763 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:48:29.392835 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:29.392854 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:29.393101 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:29.393284 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:29.394770 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.395890 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.397390 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.397990 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.398138 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:29.401126 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:29.401135 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:29.401147 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:29.401186 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:29.403947 (+ 2761us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:48:29.404256 (+ 309us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60068: Request ticket server kudu/127.8.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":424,"threads_started":1}
W20260808 08:48:29.404609 24031 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60068: Request ticket server kudu/127.8.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:48:29.404595 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23269: Not authorized: Client connection negotiation failed: client connection to 127.8.149.65:39101: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:48:29.404836 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 23269
I20260808 08:48:29.434787 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23515
W20260808 08:48:29.448316 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23515: Not authorized: Client connection negotiation failed: client connection to 127.8.149.66:35781: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:48:29.448351 24032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:29.435748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49058 (local address 127.8.149.66:35781)
0808 08:48:29.436392 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:29.436399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:29.436424 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:48:29.436487 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:29.436493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:29.436726 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:29.436884 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:29.438779 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.440017 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.441381 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.442051 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.442177 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:29.444893 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:29.444903 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:29.444915 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:29.444962 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:29.447682 (+ 2720us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:48:29.447938 (+ 256us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49058: Request ticket server kudu/127.8.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":303,"threads_started":1}
W20260808 08:48:29.448468 24032 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49058: Request ticket server kudu/127.8.149.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:48:29.448477 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 23515
I20260808 08:48:29.470665 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23729
I20260808 08:48:29.483137 24033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:29.471910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44224 (local address 127.8.149.67:35435)
0808 08:48:29.472573 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:29.472580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:29.472604 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:48:29.472663 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:29.472669 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:29.472902 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:29.473117 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:29.474472 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.475447 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.476980 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:29.477532 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:29.477694 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:29.480341 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:29.480356 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:29.480368 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:29.480422 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:29.482664 (+ 2242us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:48:29.482927 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44224: Request ticket server kudu/127.8.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":344,"threads_started":1}
W20260808 08:48:29.483218 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23729: Not authorized: Client connection negotiation failed: client connection to 127.8.149.67:35435: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.8.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:48:29.483258 24033 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44224: Request ticket server kudu/127.8.149.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:48:29.483413 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 23729
I20260808 08:48:29.510653 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 23158
I20260808 08:48:29.511960 23258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:29.631132 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 23158
2026-08-08T08:48:29Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21742 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T08:48:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:29Z Disabled control of system clock
I20260808 08:48:29.723630 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:34587
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:48:30.054225 24044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:30.054512 24044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:30.054636 24044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:30.061614 24044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:30.061791 24044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:30.061892 24044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:30.061962 24044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:30.062007 24044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:30.070542 24044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:34587
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:30.071650 24044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:30.073374 24044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:30.084929 24050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:30.084893 24051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:30.084961 24053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:30.085727 24044 server_base.cc:1034] running on GCE node
I20260808 08:48:30.086495 24044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:30.087790 24044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:30.088997 24044 hybrid_clock.cc:648] HybridClock initialized: now 1786178910088927 us; error 61 us; skew 500 ppm
I20260808 08:48:30.089342 24044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:30.091512 24044 webserver.cc:460] Webserver started at http://127.8.149.126:37837/ using document root <none> and password file <none>
I20260808 08:48:30.092252 24044 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:30.092362 24044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:30.092689 24044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:30.095325 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "f5cacfafe35c485295b6b55b2082c88e"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "589ec23398d568a0afd4fefa49b9439c"
server_key_iv: "fbb88228676820643e686463df329795"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.096076 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "f5cacfafe35c485295b6b55b2082c88e"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "589ec23398d568a0afd4fefa49b9439c"
server_key_iv: "fbb88228676820643e686463df329795"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.101046 24044 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:48:30.104451 24061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:30.105640 24044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:48:30.105824 24044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "f5cacfafe35c485295b6b55b2082c88e"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "589ec23398d568a0afd4fefa49b9439c"
server_key_iv: "fbb88228676820643e686463df329795"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.106040 24044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:30.135079 24044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:30.135839 24044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:30.136178 24044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:30.154263 24044 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:34587
I20260808 08:48:30.154335 24139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:34587 every 8 connection(s)
I20260808 08:48:30.155544 24044 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:30.159291 24140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:30.163522 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24044
I20260808 08:48:30.163745 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:48:30.164543 8789 external_mini_cluster.cc:1428] Setting key 72b4e819b2ff428a85fed4d0639369b6
I20260808 08:48:30.170928 24140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e: Bootstrap starting.
I20260808 08:48:30.174794 24140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:30.175993 24140 log.cc:824] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:30.178761 24143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:30.166479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37264 (local address 127.8.149.126:34587)
0808 08:48:30.167429 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:30.167438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:30.167486 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:48:30.169305 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:30.169325 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:30.169726 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:30.170022 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:30.170760 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.172081 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.174199 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.174830 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.175060 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:30.176316 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:30.176323 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:30.176335 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:30.177062 (+ 727us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:30.177168 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:30.177196 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:30.177320 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:30.177584 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 08:48:30.177870 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":368,"threads_started":1}
I20260808 08:48:30.179275 24140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e: No bootstrap required, opened a new log
I20260808 08:48:30.186820 24140 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } }
I20260808 08:48:30.187197 24140 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:30.187315 24140 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5cacfafe35c485295b6b55b2082c88e, State: Initialized, Role: FOLLOWER
I20260808 08:48:30.187858 24140 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } }
I20260808 08:48:30.188153 24140 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:30.188320 24140 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:30.188529 24140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:30.190721 24140 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } }
I20260808 08:48:30.191257 24140 leader_election.cc:302] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5cacfafe35c485295b6b55b2082c88e; no voters:
I20260808 08:48:30.191847 24140 leader_election.cc:288] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:48:30.192008 24145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:30.193167 24145 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [term 1 LEADER]: Becoming Leader. State: Replica: f5cacfafe35c485295b6b55b2082c88e, State: Running, Role: LEADER
I20260808 08:48:30.193655 24145 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } }
I20260808 08:48:30.194006 24140 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:30.196491 24146 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5cacfafe35c485295b6b55b2082c88e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } } }
I20260808 08:48:30.196445 24147 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5cacfafe35c485295b6b55b2082c88e. Latest consensus state: current_term: 1 leader_uuid: "f5cacfafe35c485295b6b55b2082c88e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5cacfafe35c485295b6b55b2082c88e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34587 } } }
I20260808 08:48:30.196988 24147 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:30.196864 24146 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:30.198607 24157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:30.203177 24157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:30.210950 24157 catalog_manager.cc:1347] Generated new cluster ID: a84bb3a4507343e995276df0c06ef249
I20260808 08:48:30.211052 24157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:30.231065 24157 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:48:30.232287 24157 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:30.241667 24157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5cacfafe35c485295b6b55b2082c88e: Generated new TSK 0
I20260808 08:48:30.242452 24157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:48:30.252199 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--builtin_ntp_servers=127.8.149.84:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 08:48:30.608979 24174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:30.609272 24174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:30.609355 24174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:30.616353 24174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:30.616451 24174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:30.616556 24174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:30.624974 24174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:30.626034 24174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:30.627633 24174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:30.639868 24190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:30.639986 24188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:30.639963 24193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:30.641172 24174 server_base.cc:1034] running on GCE node
I20260808 08:48:30.641750 24174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:30.642606 24174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:30.643800 24174 hybrid_clock.cc:648] HybridClock initialized: now 1786178910643757 us; error 39 us; skew 500 ppm
I20260808 08:48:30.644163 24174 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:30.646260 24174 webserver.cc:460] Webserver started at http://127.8.149.65:41401/ using document root <none> and password file <none>
I20260808 08:48:30.646891 24174 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:30.647002 24174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:30.647342 24174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:30.650074 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "ecd0b2088c92431b916fe62fc271dba8"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "75fc3618b1463f47e327ed7df2a0a8fc"
server_key_iv: "b94614f9c24920d2944060129474b90c"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.650817 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "ecd0b2088c92431b916fe62fc271dba8"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "75fc3618b1463f47e327ed7df2a0a8fc"
server_key_iv: "b94614f9c24920d2944060129474b90c"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.655479 24174 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 08:48:30.658635 24203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:30.659929 24174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:48:30.660159 24174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "ecd0b2088c92431b916fe62fc271dba8"
format_stamp: "Formatted at 2026-08-08 08:48:30 on dist-test-slave-7vjv"
server_key: "75fc3618b1463f47e327ed7df2a0a8fc"
server_key_iv: "b94614f9c24920d2944060129474b90c"
server_key_version: "encryptionkey@0"
I20260808 08:48:30.660365 24174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:30.674626 24174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:30.675360 24174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:30.675657 24174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:30.676585 24174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:30.677965 24174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:30.678088 24174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:30.678222 24174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:30.678339 24174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:30.711779 24174 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:42025
I20260808 08:48:30.711860 24373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:42025 every 8 connection(s)
I20260808 08:48:30.713153 24174 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:30.721139 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24174
I20260808 08:48:30.721357 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:48:30.722239 8789 external_mini_cluster.cc:1428] Setting key 5fd61c329b6c156dc90dc757d88a82d6
I20260808 08:48:30.725287 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--builtin_ntp_servers=127.8.149.84:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:48:30.725898 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:30.715694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:37609 (local address 127.8.149.126:34587)
0808 08:48:30.716177 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:30.716184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:30.717291 (+ 1107us) server_negotiation.cc:407] Connection header received
0808 08:48:30.719000 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:30.719004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:30.719067 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:30.719176 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:30.720269 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.721012 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.723206 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.723627 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.723723 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:30.725148 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:30.725152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:30.725155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:30.725171 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:30.725210 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:30.725221 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:30.725288 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:30.725583 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 08:48:30.725656 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":227,"threads_started":1}
I20260808 08:48:30.727185 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:30.716275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34587 (local address 127.8.149.65:37609)
0808 08:48:30.717138 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:30.717182 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:30.718774 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:30.719387 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:30.719394 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:30.719471 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:30.720035 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:30.720052 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.721175 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.721180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:30.723083 (+ 1903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:30.723095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:30.723851 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:30.723860 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:30.724067 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:30.724830 (+ 763us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:30.724834 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:30.724882 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:30.724975 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:30.725322 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:30.725335 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:30.725343 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:48:30.725530 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 08:48:30.725893 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":294,"threads_started":1}
I20260808 08:48:30.728677 24374 heartbeater.cc:347] Connected to a master server at 127.8.149.126:34587
I20260808 08:48:30.728981 24374 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:30.729867 24374 heartbeater.cc:511] Master 127.8.149.126:34587 requested a full tablet report, sending...
I20260808 08:48:30.731789 24091 ts_manager.cc:194] Registered new tserver with Master: ecd0b2088c92431b916fe62fc271dba8 (127.8.149.65:42025)
I20260808 08:48:30.733306 24091 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.65:37609
W20260808 08:48:31.050905 24378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:31.051187 24378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:31.051342 24378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:31.058100 24378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:31.058210 24378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:31.058379 24378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:31.066848 24378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:31.068009 24378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:31.069654 24378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:31.082329 24384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:31.082368 24385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:31.082441 24387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:31.083217 24378 server_base.cc:1034] running on GCE node
I20260808 08:48:31.083858 24378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:31.084844 24378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:31.086056 24378 hybrid_clock.cc:648] HybridClock initialized: now 1786178911086006 us; error 53 us; skew 500 ppm
I20260808 08:48:31.086400 24378 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:31.088553 24378 webserver.cc:460] Webserver started at http://127.8.149.66:41637/ using document root <none> and password file <none>
I20260808 08:48:31.089231 24378 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:31.089365 24378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:31.089672 24378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:31.092379 24378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "787cf1372e2e4889a3b13e87ba3ed8b7"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2acce4571ceb6d1bcd842bc14890d435"
server_key_iv: "a2c76f99e458c25fd8349615e2cbe0d8"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.093116 24378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "787cf1372e2e4889a3b13e87ba3ed8b7"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2acce4571ceb6d1bcd842bc14890d435"
server_key_iv: "a2c76f99e458c25fd8349615e2cbe0d8"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.097908 24378 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:48:31.101197 24396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.102403 24378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:48:31.102564 24378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "787cf1372e2e4889a3b13e87ba3ed8b7"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2acce4571ceb6d1bcd842bc14890d435"
server_key_iv: "a2c76f99e458c25fd8349615e2cbe0d8"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.102778 24378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:31.123718 24378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:31.124475 24378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:31.124764 24378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:31.125638 24378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:31.127051 24378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:31.127169 24378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.127281 24378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:31.127363 24378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.161827 24378 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:46459
I20260808 08:48:31.161899 24572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:46459 every 8 connection(s)
I20260808 08:48:31.163017 24378 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:31.172847 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24378
I20260808 08:48:31.173082 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:48:31.173655 8789 external_mini_cluster.cc:1428] Setting key 00e6ce7d36c14731e7ae01eb62bafe1f
I20260808 08:48:31.176501 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--builtin_ntp_servers=127.8.149.84:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:48:31.176941 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.165744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:46899 (local address 127.8.149.126:34587)
0808 08:48:31.165990 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.165997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.167442 (+ 1445us) server_negotiation.cc:407] Connection header received
0808 08:48:31.169861 (+ 2419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.169866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.169934 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.170021 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.171250 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.171920 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.174236 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.174611 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.174736 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.176063 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:31.176071 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:31.176077 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:31.176126 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:31.176165 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:31.176184 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:31.176282 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:31.176483 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 08:48:31.176584 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:48:31.177760 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.166227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34587 (local address 127.8.149.66:46899)
0808 08:48:31.167269 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:31.167311 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:31.169596 (+ 2285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:31.170255 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:31.170265 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:31.170402 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:31.171080 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:31.171100 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.172074 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.172077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:31.174100 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:31.174115 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.174800 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.174804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:31.175045 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.175785 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:31.175787 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:31.175822 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:31.175891 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:31.176277 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:31.176284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:31.176289 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:48:31.176442 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 08:48:31.176801 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":295,"threads_started":1}
I20260808 08:48:31.179023 24574 heartbeater.cc:347] Connected to a master server at 127.8.149.126:34587
I20260808 08:48:31.179282 24574 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:31.179956 24574 heartbeater.cc:511] Master 127.8.149.126:34587 requested a full tablet report, sending...
I20260808 08:48:31.181248 24091 ts_manager.cc:194] Registered new tserver with Master: 787cf1372e2e4889a3b13e87ba3ed8b7 (127.8.149.66:46459)
I20260808 08:48:31.182067 24091 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.66:46899
W20260808 08:48:31.510399 24578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:31.510697 24578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:31.510849 24578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:31.517809 24578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:31.517922 24578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:31.518079 24578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:31.526502 24578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:34587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:31.527645 24578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:31.529341 24578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:31.542140 24590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:31.542097 24593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:31.542176 24591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:31.543624 24578 server_base.cc:1034] running on GCE node
I20260808 08:48:31.544298 24578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:31.545181 24578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:31.546416 24578 hybrid_clock.cc:648] HybridClock initialized: now 1786178911546372 us; error 58 us; skew 500 ppm
I20260808 08:48:31.546744 24578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:31.548974 24578 webserver.cc:460] Webserver started at http://127.8.149.67:41719/ using document root <none> and password file <none>
I20260808 08:48:31.549613 24578 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:31.549750 24578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:31.550073 24578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:31.552920 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "9da7924a2e794e47aed5d0d4027177c5"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2b85dd657d92b305c5b00498556a91df"
server_key_iv: "31545f67d07e751d3dadb6f83058d623"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.553695 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "9da7924a2e794e47aed5d0d4027177c5"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2b85dd657d92b305c5b00498556a91df"
server_key_iv: "31545f67d07e751d3dadb6f83058d623"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.558398 24578 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 08:48:31.561774 24600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.563071 24578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:48:31.563251 24578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "9da7924a2e794e47aed5d0d4027177c5"
format_stamp: "Formatted at 2026-08-08 08:48:31 on dist-test-slave-7vjv"
server_key: "2b85dd657d92b305c5b00498556a91df"
server_key_iv: "31545f67d07e751d3dadb6f83058d623"
server_key_version: "encryptionkey@0"
I20260808 08:48:31.563504 24578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:31.584228 24578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:31.584944 24578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:31.585238 24578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:31.586158 24578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:31.587570 24578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:31.587688 24578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.587814 24578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:31.587905 24578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:31.622143 24578 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:33907
I20260808 08:48:31.622246 24761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:33907 every 8 connection(s)
I20260808 08:48:31.623463 24578 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:31.623783 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24578
I20260808 08:48:31.623940 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:48:31.624575 8789 external_mini_cluster.cc:1428] Setting key 01aff74f57b8992fef9a2eb27f40bbf5
I20260808 08:48:31.637326 24376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.626428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:52981 (local address 127.8.149.126:34587)
0808 08:48:31.626672 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.626678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.628395 (+ 1717us) server_negotiation.cc:407] Connection header received
0808 08:48:31.630210 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.630217 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.630314 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.630442 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.631548 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.632373 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.634286 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.634767 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.634922 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.636467 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:31.636472 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:31.636476 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:31.636495 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:31.636527 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:31.636540 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:31.636655 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:31.636883 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 08:48:31.636985 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:48:31.638334 24766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.627079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34587 (local address 127.8.149.67:52981)
0808 08:48:31.628241 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:31.628277 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:31.629915 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:31.630686 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:31.630695 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:31.630792 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:31.631378 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:31.631397 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.632554 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.632559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:31.634110 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:31.634124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.635073 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.635086 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:31.635315 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.636037 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:31.636041 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:31.636140 (+ 99us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:31.636233 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:31.636657 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:31.636670 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:31.636682 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:48:31.636868 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 08:48:31.637257 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":336,"threads_started":1}
I20260808 08:48:31.639917 24762 heartbeater.cc:347] Connected to a master server at 127.8.149.126:34587
I20260808 08:48:31.640269 24762 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:31.641068 24762 heartbeater.cc:511] Master 127.8.149.126:34587 requested a full tablet report, sending...
I20260808 08:48:31.642432 24090 ts_manager.cc:194] Registered new tserver with Master: 9da7924a2e794e47aed5d0d4027177c5 (127.8.149.67:33907)
I20260808 08:48:31.643273 24090 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.67:52981
I20260808 08:48:31.652618 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:48:31.665834 24376 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:31.664212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37266 (local address 127.8.149.126:34587)
0808 08:48:31.664448 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.664456 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.664825 (+ 369us) server_negotiation.cc:407] Connection header received
0808 08:48:31.665000 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.665004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.665072 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.665176 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.665568 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37266: BlockingRecv error: recv got EOF from 127.0.0.1:37266 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:48:31.666908 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24174
I20260808 08:48:31.674666 24779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.668068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58370 (local address 127.8.149.65:42025)
0808 08:48:31.668633 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.668639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.668662 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:48:31.668712 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.668718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.668908 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.669025 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.669366 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.670318 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.671563 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.672069 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.672220 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.673295 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:31.673310 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:31.673321 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:31.673864 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:31.673912 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:31.673930 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:31.674058 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:31.674203 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 08:48:31.674330 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":249,"threads_started":1}
I20260808 08:48:31.676049 24367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:31.771027 24374 heartbeater.cc:503] Master 127.8.149.126:34587 was elected leader, sending a full tablet report...
I20260808 08:48:31.773159 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24174
I20260808 08:48:31.798004 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24378
I20260808 08:48:31.806291 24783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.798921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53042 (local address 127.8.149.66:46459)
0808 08:48:31.799522 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.799529 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.799557 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:48:31.799629 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.799635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.799851 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.800018 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.800434 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.801613 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.802823 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.803412 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.803523 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.804586 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:31.804595 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:31.804608 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:31.805302 (+ 694us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:31.805353 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:31.805380 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:31.805478 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:31.805691 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 08:48:31.805853 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":308,"threads_started":1}
I20260808 08:48:31.807565 24567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:31.886623 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24378
I20260808 08:48:31.912907 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24578
I20260808 08:48:31.921204 24789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:31.913881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56226 (local address 127.8.149.67:33907)
0808 08:48:31.914521 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:31.914535 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:31.914564 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:48:31.914621 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:31.914627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:31.914834 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:31.915017 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:31.915512 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.916614 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.917861 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:31.918422 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:31.918553 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:31.919680 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:31.919687 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:31.919700 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:31.920385 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:31.920436 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:31.920455 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:31.920575 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:31.920746 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:48:31.920868 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":345,"threads_started":1}
I20260808 08:48:31.922380 24755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:32.003243 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24578
I20260808 08:48:32.027176 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24044
I20260808 08:48:32.028445 24135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:32.126124 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24044
2026-08-08T08:48:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2488 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T08:48:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:32Z Disabled control of system clock
I20260808 08:48:32.214468 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36137
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:46865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:36137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:48:32.541152 24799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:32.541409 24799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:32.541581 24799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:32.548733 24799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:32.549000 24799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:32.549155 24799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:32.549273 24799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:32.549350 24799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:32.557698 24799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:46865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:36137
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:32.558877 24799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:32.560573 24799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:32.571892 24810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:32.571990 24809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:32.572000 24812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:32.572640 24799 server_base.cc:1034] running on GCE node
I20260808 08:48:32.573331 24799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:32.574507 24799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:32.575706 24799 hybrid_clock.cc:648] HybridClock initialized: now 1786178912575656 us; error 42 us; skew 500 ppm
I20260808 08:48:32.576028 24799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:32.578240 24799 webserver.cc:460] Webserver started at http://127.8.149.126:43181/ using document root <none> and password file <none>
I20260808 08:48:32.578931 24799 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:32.579053 24799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:32.579408 24799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:32.582165 24799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "dfecaaba5145415eafa542d45dc2941f"
format_stamp: "Formatted at 2026-08-08 08:48:32 on dist-test-slave-7vjv"
server_key: "1ffa5e7413d4fa74d11ae276077445bf"
server_key_iv: "111e027fd8bd8de77ae533e7d4c04d0e"
server_key_version: "encryptionkey@0"
I20260808 08:48:32.582926 24799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "dfecaaba5145415eafa542d45dc2941f"
format_stamp: "Formatted at 2026-08-08 08:48:32 on dist-test-slave-7vjv"
server_key: "1ffa5e7413d4fa74d11ae276077445bf"
server_key_iv: "111e027fd8bd8de77ae533e7d4c04d0e"
server_key_version: "encryptionkey@0"
I20260808 08:48:32.587646 24799 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 08:48:32.590876 24820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:32.592075 24799 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:48:32.592275 24799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "dfecaaba5145415eafa542d45dc2941f"
format_stamp: "Formatted at 2026-08-08 08:48:32 on dist-test-slave-7vjv"
server_key: "1ffa5e7413d4fa74d11ae276077445bf"
server_key_iv: "111e027fd8bd8de77ae533e7d4c04d0e"
server_key_version: "encryptionkey@0"
I20260808 08:48:32.592468 24799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:32.597707 24799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:32.598420 24799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:32.598714 24799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:32.616495 24799 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:36137
I20260808 08:48:32.616564 24904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:36137 every 8 connection(s)
I20260808 08:48:32.617656 24799 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:32.620985 24906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:32.623747 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24799
I20260808 08:48:32.623972 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:48:32.624832 8789 external_mini_cluster.cc:1428] Setting key 35d0745e39fed05efb30c85c2d5e6f95
I20260808 08:48:32.632766 24911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:32.626846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.8.149.126:36137)
0808 08:48:32.627773 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:32.627782 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:32.627824 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:48:32.629491 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:32.629512 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:32.629895 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:32.630182 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:32.631211 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:32.631219 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:32.631229 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:32.631247 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:32.631296 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:32.631312 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:32.631484 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:32.631613 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 08:48:32.631874 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":374,"threads_started":1}
I20260808 08:48:32.633306 24906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f: Bootstrap starting.
I20260808 08:48:32.636075 24906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:32.637061 24906 log.cc:824] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:32.639369 24906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f: No bootstrap required, opened a new log
I20260808 08:48:32.646459 24906 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } }
I20260808 08:48:32.646782 24906 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:32.646903 24906 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfecaaba5145415eafa542d45dc2941f, State: Initialized, Role: FOLLOWER
I20260808 08:48:32.647478 24906 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } }
I20260808 08:48:32.647704 24906 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:32.647838 24906 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:32.648021 24906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:32.650115 24906 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } }
I20260808 08:48:32.650586 24906 leader_election.cc:302] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfecaaba5145415eafa542d45dc2941f; no voters:
I20260808 08:48:32.651156 24906 leader_election.cc:288] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:48:32.651301 24916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:32.651999 24916 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [term 1 LEADER]: Becoming Leader. State: Replica: dfecaaba5145415eafa542d45dc2941f, State: Running, Role: LEADER
I20260808 08:48:32.652601 24916 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } }
I20260808 08:48:32.653065 24906 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:32.655609 24918 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfecaaba5145415eafa542d45dc2941f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } } }
I20260808 08:48:32.655642 24919 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfecaaba5145415eafa542d45dc2941f. Latest consensus state: current_term: 1 leader_uuid: "dfecaaba5145415eafa542d45dc2941f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfecaaba5145415eafa542d45dc2941f" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36137 } } }
I20260808 08:48:32.655990 24919 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:32.655989 24918 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:32.658293 24928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:32.662606 24928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:32.671124 24928 catalog_manager.cc:1347] Generated new cluster ID: 560999a27dd8418e9ba2f21121ac0751
I20260808 08:48:32.671222 24928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:32.690954 24928 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:48:32.691371 24928 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:32.699733 24928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfecaaba5145415eafa542d45dc2941f: Generated new TSK 0
I20260808 08:48:32.700635 24928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:48:32.708954 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--builtin_ntp_servers=127.8.149.84:46865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:48:33.042186 24946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:33.042423 24946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:33.042523 24946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:33.049185 24946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:33.049264 24946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:33.049363 24946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:33.057627 24946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:46865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:33.058780 24946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:33.060458 24946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:33.072715 24962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.072744 24958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.073240 24957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:33.073776 24946 server_base.cc:1034] running on GCE node
I20260808 08:48:33.074345 24946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:33.075338 24946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:33.076576 24946 hybrid_clock.cc:648] HybridClock initialized: now 1786178913076540 us; error 39 us; skew 500 ppm
I20260808 08:48:33.076887 24946 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:33.078931 24946 webserver.cc:460] Webserver started at http://127.8.149.65:37085/ using document root <none> and password file <none>
I20260808 08:48:33.079576 24946 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:33.079712 24946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:33.080035 24946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:33.082697 24946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "d0f16708cf0b4ea5bb0dc353f971d967"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "e77b9514f163ab5678b5e6b8096b732c"
server_key_iv: "8a87dae13497b3366d2df2df0a3134e5"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.083514 24946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "d0f16708cf0b4ea5bb0dc353f971d967"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "e77b9514f163ab5678b5e6b8096b732c"
server_key_iv: "8a87dae13497b3366d2df2df0a3134e5"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.088410 24946 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:48:33.091557 24974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.092823 24946 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:48:33.092978 24946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "d0f16708cf0b4ea5bb0dc353f971d967"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "e77b9514f163ab5678b5e6b8096b732c"
server_key_iv: "8a87dae13497b3366d2df2df0a3134e5"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.093189 24946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:33.098758 24946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:33.099560 24946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:33.099844 24946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:33.100963 24946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:33.102445 24946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:33.102566 24946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.102689 24946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:33.102773 24946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.135562 24946 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:40411
I20260808 08:48:33.135608 25156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:40411 every 8 connection(s)
I20260808 08:48:33.136857 24946 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:33.144438 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:33.139137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:53793 (local address 127.8.149.126:36137)
0808 08:48:33.139538 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:33.139543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:33.140595 (+ 1052us) server_negotiation.cc:407] Connection header received
0808 08:48:33.142231 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:33.142237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:33.142306 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:33.142433 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:33.143635 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:33.143641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:33.143645 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:33.143669 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:33.143709 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:33.143720 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:33.143853 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:33.144073 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 08:48:33.144160 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":217,"threads_started":1}
I20260808 08:48:33.145231 25167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:33.139569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36137 (local address 127.8.149.65:53793)
0808 08:48:33.140453 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:33.140492 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:33.141973 (+ 1481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:33.142644 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:33.142652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:33.142727 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:33.143352 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:33.143355 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:33.143388 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:33.143473 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:33.143842 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:33.143853 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:33.143862 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:48:33.144169 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 08:48:33.144387 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":261,"threads_started":1}
I20260808 08:48:33.146061 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 24946
I20260808 08:48:33.146275 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:48:33.146647 25161 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36137
I20260808 08:48:33.146908 25161 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:33.147042 8789 external_mini_cluster.cc:1428] Setting key cd51bf3edb49817c529fcc9223415906
I20260808 08:48:33.147464 25161 heartbeater.cc:511] Master 127.8.149.126:36137 requested a full tablet report, sending...
I20260808 08:48:33.149399 24850 ts_manager.cc:194] Registered new tserver with Master: d0f16708cf0b4ea5bb0dc353f971d967 (127.8.149.65:40411)
I20260808 08:48:33.149641 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--builtin_ntp_servers=127.8.149.84:46865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:48:33.492043 25168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:33.492372 25168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:33.492543 25168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:33.500016 25168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:33.500169 25168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:33.500389 25168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:33.509876 25168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:46865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:33.511085 25168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:33.513063 25168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:33.525882 25178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.525996 25177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.525954 25182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:33.527158 25168 server_base.cc:1034] running on GCE node
I20260808 08:48:33.527696 25168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:33.528628 25168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:33.529877 25168 hybrid_clock.cc:648] HybridClock initialized: now 1786178913529824 us; error 58 us; skew 500 ppm
I20260808 08:48:33.530210 25168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:33.532492 25168 webserver.cc:460] Webserver started at http://127.8.149.66:35793/ using document root <none> and password file <none>
I20260808 08:48:33.533164 25168 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:33.533298 25168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:33.533635 25168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:33.536422 25168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "251744ef9a06437e9818064a6a523bd5"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "2909c8cfbd92b9e551cbd77f6864a78d"
server_key_iv: "3f00e44ac2b3f737bb3128194fdf775a"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.537292 25168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "251744ef9a06437e9818064a6a523bd5"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "2909c8cfbd92b9e551cbd77f6864a78d"
server_key_iv: "3f00e44ac2b3f737bb3128194fdf775a"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.542071 25168 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:48:33.545506 25196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.546744 25168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:48:33.546900 25168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "251744ef9a06437e9818064a6a523bd5"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "2909c8cfbd92b9e551cbd77f6864a78d"
server_key_iv: "3f00e44ac2b3f737bb3128194fdf775a"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.547096 25168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:33.552397 25168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:33.553159 25168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:33.553375 25168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:33.554405 25168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:33.555737 25168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:33.555859 25168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.556008 25168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:33.556116 25168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.589533 25168 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:36653
I20260808 08:48:33.589612 25380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:36653 every 8 connection(s)
I20260808 08:48:33.590740 25168 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:33.597882 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 25168
I20260808 08:48:33.598081 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:48:33.598724 8789 external_mini_cluster.cc:1428] Setting key 0323e2e597b893cf7be1fd55424e8da7
I20260808 08:48:33.598927 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:33.593365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:34455 (local address 127.8.149.126:36137)
0808 08:48:33.593530 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:33.593535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:33.594802 (+ 1267us) server_negotiation.cc:407] Connection header received
0808 08:48:33.596627 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:33.596631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:33.596694 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:33.596796 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:33.598160 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:33.598168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:33.598174 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:33.598193 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:33.598231 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:33.598249 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:33.598372 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:33.598558 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 08:48:33.598623 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:48:33.599704 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:33.593760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36137 (local address 127.8.149.66:34455)
0808 08:48:33.594677 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:33.594715 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:33.596385 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:33.597042 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:33.597049 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:33.597142 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:33.597806 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:33.597809 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:33.597843 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:33.597951 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:33.598344 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:33.598352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:33.598357 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:48:33.598581 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 08:48:33.598748 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":280,"threads_started":1}
I20260808 08:48:33.600968 25384 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36137
I20260808 08:48:33.601253 25384 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:33.601653 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--builtin_ntp_servers=127.8.149.84:46865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:48:33.601832 25384 heartbeater.cc:511] Master 127.8.149.126:36137 requested a full tablet report, sending...
I20260808 08:48:33.603220 24849 ts_manager.cc:194] Registered new tserver with Master: 251744ef9a06437e9818064a6a523bd5 (127.8.149.66:36653)
W20260808 08:48:33.936321 25388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:33.936586 25388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:33.936817 25388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:33.943884 25388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:33.943967 25388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:33.944186 25388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:33.954564 25388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:46865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:36137
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:33.955725 25388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:33.957568 25388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:33.970554 25394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.970525 25398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:33.970726 25395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:33.971683 25388 server_base.cc:1034] running on GCE node
I20260808 08:48:33.972411 25388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:33.973279 25388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:33.974501 25388 hybrid_clock.cc:648] HybridClock initialized: now 1786178913974455 us; error 56 us; skew 500 ppm
I20260808 08:48:33.974794 25388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:48:33.977008 25388 webserver.cc:460] Webserver started at http://127.8.149.67:33619/ using document root <none> and password file <none>
I20260808 08:48:33.977679 25388 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:33.977807 25388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:33.978132 25388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:33.980962 25388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "f6e31773b54f475baf58bdf7cfd4ed2d"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "94b7865cbe9f6d666080f69750bb9000"
server_key_iv: "25187f6831728336d14fe9cb58ab7002"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.981742 25388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "f6e31773b54f475baf58bdf7cfd4ed2d"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "94b7865cbe9f6d666080f69750bb9000"
server_key_iv: "25187f6831728336d14fe9cb58ab7002"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.986487 25388 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:48:33.989701 25405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:33.990849 25388 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:48:33.990993 25388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "f6e31773b54f475baf58bdf7cfd4ed2d"
format_stamp: "Formatted at 2026-08-08 08:48:33 on dist-test-slave-7vjv"
server_key: "94b7865cbe9f6d666080f69750bb9000"
server_key_iv: "25187f6831728336d14fe9cb58ab7002"
server_key_version: "encryptionkey@0"
I20260808 08:48:33.991219 25388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:33.996507 25388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:33.997303 25388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:33.997541 25388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:33.998492 25388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:34.000169 25388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:34.000300 25388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:34.000478 25388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:34.000574 25388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:34.032716 25388 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46711
I20260808 08:48:34.032765 25578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46711 every 8 connection(s)
I20260808 08:48:34.034091 25388 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:34.041548 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 25388
I20260808 08:48:34.041775 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:48:34.042253 8789 external_mini_cluster.cc:1428] Setting key be9dac7694b5474c4aaadcbd7a91ba2a
I20260808 08:48:34.042250 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:34.036686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42859 (local address 127.8.149.126:36137)
0808 08:48:34.036864 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:34.036869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:34.038141 (+ 1272us) server_negotiation.cc:407] Connection header received
0808 08:48:34.039799 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:34.039805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:34.039881 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:34.039998 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:34.041442 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:34.041448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:34.041453 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:34.041480 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:34.041511 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:34.041523 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:34.041660 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:34.041879 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 08:48:34.041966 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:48:34.043202 25582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:34.037078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:36137 (local address 127.8.149.67:42859)
0808 08:48:34.037974 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:34.038015 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:34.039515 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:34.040287 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:34.040295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:34.040381 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:34.041119 (+ 738us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:48:34.041121 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:34.041158 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:48:34.041240 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:34.041625 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:34.041637 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:34.041646 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:48:34.041984 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 08:48:34.042211 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":281,"threads_started":1}
I20260808 08:48:34.044600 25580 heartbeater.cc:347] Connected to a master server at 127.8.149.126:36137
I20260808 08:48:34.044888 25580 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:34.045390 25580 heartbeater.cc:511] Master 127.8.149.126:36137 requested a full tablet report, sending...
I20260808 08:48:34.046595 24849 ts_manager.cc:194] Registered new tserver with Master: f6e31773b54f475baf58bdf7cfd4ed2d (127.8.149.67:46711)
I20260808 08:48:34.057606 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:48:34.063731 25166 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:48:34.062116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33648 (local address 127.8.149.126:36137)
0808 08:48:34.062269 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:34.062273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:34.062766 (+ 493us) server_negotiation.cc:407] Connection header received
0808 08:48:34.062968 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:34.062973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:34.063036 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:34.063137 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:34.063490 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33648: BlockingRecv error: recv got EOF from 127.0.0.1:33648 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:48:34.064211 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24946
I20260808 08:48:34.067548 25592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:34.065215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.8.149.65:40411)
0808 08:48:34.065736 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:34.065742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:34.065766 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:48:34.065819 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:34.065824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:34.065993 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:34.066108 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:34.067005 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:34.067012 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:34.067021 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:34.067041 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:34.067084 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:34.067099 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:34.067202 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:34.067247 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 08:48:34.067319 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":265,"threads_started":1}
I20260808 08:48:34.068758 25147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:34.145931 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24946
I20260808 08:48:34.175137 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 25168
I20260808 08:48:34.178766 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:34.176089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.8.149.66:36653)
0808 08:48:34.176593 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:34.176599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:34.176625 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:48:34.176685 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:34.176691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:34.176922 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:34.177044 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:34.178078 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:34.178085 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:34.178096 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:34.178110 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:34.178155 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:34.178170 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:34.178278 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:34.178380 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 08:48:34.178502 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":229,"threads_started":1}
I20260808 08:48:34.180071 25373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:34.257462 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 25168
I20260808 08:48:34.284029 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 25388
I20260808 08:48:34.288210 25599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:34.285146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39980 (local address 127.8.149.67:46711)
0808 08:48:34.285826 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:34.285833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:34.285895 (+ 62us) server_negotiation.cc:407] Connection header received
0808 08:48:34.285960 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:34.285966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:34.286172 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:34.286296 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:34.287385 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:34.287392 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:34.287403 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:48:34.287422 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:34.287464 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:48:34.287480 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:34.287623 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:34.287680 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 08:48:34.287762 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":339,"threads_started":1}
I20260808 08:48:34.289449 25570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:34.372035 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 25388
I20260808 08:48:34.396728 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 24799
I20260808 08:48:34.397907 24895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:34.496693 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 24799
2026-08-08T08:48:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2371 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:48:34 dist-test-slave-7vjv krb5kdc[25606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:48:34 dist-test-slave-7vjv krb5kdc[25606](info): set up 2 sockets
Aug 08 08:48:34 dist-test-slave-7vjv krb5kdc[25606](info): commencing operation
krb5kdc: starting...
W20260808 08:48:35.793527 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:48:35 dist-test-slave-7vjv krb5kdc[25606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:48:36.039790 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33587
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:33587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:36.363781 25625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:36.364096 25625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:36.364280 25625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:36.370952 25625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:48:36.371065 25625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:36.371157 25625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:36.371274 25625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:48:36.371356 25625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:48:36.380373 25625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:33587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:33587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:36.381595 25625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:36.382891 25625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:36.394452 25639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:36.394505 25635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:36.394994 25632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:36.395828 25625 server_base.cc:1034] running on GCE node
I20260808 08:48:36.396971 25625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:36.398413 25625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:36.399746 25625 hybrid_clock.cc:648] HybridClock initialized: now 1786178916399674 us; error 48 us; skew 500 ppm
I20260808 08:48:36.400141 25625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:36 dist-test-slave-7vjv krb5kdc[25606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178916, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:36.406674 25625 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:48:36.408259 25625 webserver.cc:460] Webserver started at http://127.8.149.126:35023/ using document root <none> and password file <none>
I20260808 08:48:36.408942 25625 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:36.409097 25625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:36.409402 25625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:36.412497 25625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "0a4cc8857834481686398e777b96a594"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "56c27d31046862d95bbe5926b8636c3c"
server_key_iv: "c7aaa9e0123a218df490adb9e811b960"
server_key_version: "encryptionkey@0"
I20260808 08:48:36.413204 25625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "0a4cc8857834481686398e777b96a594"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "56c27d31046862d95bbe5926b8636c3c"
server_key_iv: "c7aaa9e0123a218df490adb9e811b960"
server_key_version: "encryptionkey@0"
I20260808 08:48:36.418210 25625 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:48:36.421625 25651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:36.422901 25625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:48:36.423096 25625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "0a4cc8857834481686398e777b96a594"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "56c27d31046862d95bbe5926b8636c3c"
server_key_iv: "c7aaa9e0123a218df490adb9e811b960"
server_key_version: "encryptionkey@0"
I20260808 08:48:36.423295 25625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:36.445096 25625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:36.448737 25625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:36.449003 25625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:36.467582 25625 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:33587
I20260808 08:48:36.467653 25746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:33587 every 8 connection(s)
I20260808 08:48:36.468786 25625 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:48:36.472059 25747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:36.472508 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 25625
I20260808 08:48:36.472764 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:48:36.473382 8789 external_mini_cluster.cc:1428] Setting key 7ce8571b2e4248f37194730c92494616
I20260808 08:48:36.485249 25747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: Bootstrap starting.
Aug 08 08:48:36 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:36.488685 25747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:36.489784 25747 log.cc:824] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:36.492794 25747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: No bootstrap required, opened a new log
I20260808 08:48:36.496285 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:36.475396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34536 (local address 127.8.149.126:33587)
0808 08:48:36.476181 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:36.476196 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:36.476253 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:48:36.477809 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:36.477829 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:36.478166 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:36.478485 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:36.480350 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:36.481523 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:36.483302 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:36.483909 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:36.484025 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:36.488554 (+ 4529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:36.488560 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:36.488572 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:36.488610 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:36.492056 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:36.492741 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:36.492750 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:36.492761 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:36.492995 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:36.493359 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:36.493364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:36.493367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:36.494024 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:36.494354 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:36.494609 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 08:48:36.495046 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":338,"threads_started":1}
I20260808 08:48:36.501689 25747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } }
I20260808 08:48:36.502014 25747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:36.502080 25747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a4cc8857834481686398e777b96a594, State: Initialized, Role: FOLLOWER
I20260808 08:48:36.502502 25747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } }
I20260808 08:48:36.502677 25747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:48:36.502764 25747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:48:36.502871 25747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:36.504935 25747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } }
I20260808 08:48:36.505335 25747 leader_election.cc:302] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a4cc8857834481686398e777b96a594; no voters:
I20260808 08:48:36.505863 25747 leader_election.cc:288] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:48:36.506001 25753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:36.506850 25753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [term 1 LEADER]: Becoming Leader. State: Replica: 0a4cc8857834481686398e777b96a594, State: Running, Role: LEADER
I20260808 08:48:36.507405 25753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } }
I20260808 08:48:36.508143 25747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:48:36.510705 25755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a4cc8857834481686398e777b96a594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } } }
I20260808 08:48:36.511086 25755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:36.510759 25756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a4cc8857834481686398e777b96a594. Latest consensus state: current_term: 1 leader_uuid: "0a4cc8857834481686398e777b96a594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a4cc8857834481686398e777b96a594" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 33587 } } }
I20260808 08:48:36.511222 25756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594 [sys.catalog]: This master's current role is: LEADER
I20260808 08:48:36.513005 25762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:48:36.519181 25762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:48:36.528930 25762 catalog_manager.cc:1347] Generated new cluster ID: ccb8117a93fb479b875c708f2c416561
I20260808 08:48:36.529066 25762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:48:36.538612 25762 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:48:36.539863 25762 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:48:36.553685 25762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: Generated new TSK 0
I20260808 08:48:36.554505 25762 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:48:36.628660 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:36.951110 25782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:36.951354 25782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:36.951548 25782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:36.959388 25782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:36.959517 25782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:36.959720 25782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:48:36.968777 25782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:36.969944 25782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:36.971181 25782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:36.984023 25791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:36.984066 25795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:36.983996 25787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:36.985127 25782 server_base.cc:1034] running on GCE node
I20260808 08:48:36.985772 25782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:36.986619 25782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:36.987851 25782 hybrid_clock.cc:648] HybridClock initialized: now 1786178916987811 us; error 49 us; skew 500 ppm
I20260808 08:48:36.988255 25782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:36 dist-test-slave-7vjv krb5kdc[25606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178916, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:36.991390 25782 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:48:36.992846 25782 webserver.cc:460] Webserver started at http://127.8.149.65:46709/ using document root <none> and password file <none>
I20260808 08:48:36.993516 25782 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:36.993661 25782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:36.993966 25782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:36.997206 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "791be19adf36158909f7484f8e052145"
server_key_iv: "ef6353efc48ac3c1987a80a9b04aaf14"
server_key_version: "encryptionkey@0"
I20260808 08:48:36.997951 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "791be19adf36158909f7484f8e052145"
server_key_iv: "ef6353efc48ac3c1987a80a9b04aaf14"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.002830 25782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260808 08:48:37.006273 25804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.007618 25782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:48:37.007791 25782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895"
format_stamp: "Formatted at 2026-08-08 08:48:36 on dist-test-slave-7vjv"
server_key: "791be19adf36158909f7484f8e052145"
server_key_iv: "ef6353efc48ac3c1987a80a9b04aaf14"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.007999 25782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:37.022713 25782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:37.026834 25782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:37.027122 25782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:37.028039 25782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:37.029436 25782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:37.029538 25782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.029690 25782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:37.029779 25782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.063256 25782 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34543
I20260808 08:48:37.063333 25983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34543 every 8 connection(s)
I20260808 08:48:37.064553 25782 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:48:37.072710 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 25782
I20260808 08:48:37.072921 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:48:37.073521 8789 external_mini_cluster.cc:1428] Setting key 5331cbb0f51c3fa323dd6265a42f0b6f
Aug 08 08:48:37 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178916, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:37.085041 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:37.067301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:33837 (local address 127.8.149.126:33587)
0808 08:48:37.067742 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:37.067746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:37.068668 (+ 922us) server_negotiation.cc:407] Connection header received
0808 08:48:37.070420 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:37.070425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:37.070519 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:37.070639 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:37.072039 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.072844 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.074634 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.075026 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.075137 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:37.078809 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:37.078815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:37.078818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:37.078853 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:37.081698 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:37.082442 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:37.082450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:37.082456 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:37.082598 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:37.083063 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:37.083068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:37.083071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:37.083378 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:37.083573 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:37.084327 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 08:48:37.084591 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":242,"threads_started":1}
I20260808 08:48:37.085913 25988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:37.067784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33587 (local address 127.8.149.65:33837)
0808 08:48:37.068510 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:37.068551 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:37.070139 (+ 1588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:37.070855 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:37.070865 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:37.071337 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:37.071859 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:37.071879 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.073030 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.073034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:37.074485 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:37.074498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.075290 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.075300 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:37.075607 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:37.076306 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:37.076328 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:37.078576 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:37.081852 (+ 3276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:37.081861 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:37.081875 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:37.082300 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:37.082729 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:37.082735 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:37.082739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:37.082930 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:37.083540 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:37.083548 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:37.083903 (+ 355us) client_negotiation.cc:769] Sending connection context
0808 08:48:37.084237 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 08:48:37.084768 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":319,"threads_started":1}
I20260808 08:48:37.087532 25985 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33587
I20260808 08:48:37.087839 25985 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:37.088678 25985 heartbeater.cc:511] Master 127.8.149.126:33587 requested a full tablet report, sending...
I20260808 08:48:37.090821 25679 ts_manager.cc:194] Registered new tserver with Master: 8dfe9ab0889d4e25b3fb44b8e56fc895 (127.8.149.65:34543)
I20260808 08:48:37.092396 25679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:33837
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:48:37.133067 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:37.462409 25991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:37.462656 25991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:37.462741 25991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:37.469779 25991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:37.469874 25991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:37.470048 25991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:48:37.479449 25991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:37.480607 25991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:37.481865 25991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:37.494256 26003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:37.494396 26004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:37.494436 26008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:37.496052 25991 server_base.cc:1034] running on GCE node
I20260808 08:48:37.496737 25991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:37.497620 25991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:37.498847 25991 hybrid_clock.cc:648] HybridClock initialized: now 1786178917498786 us; error 72 us; skew 500 ppm
I20260808 08:48:37.499151 25991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:37 dist-test-slave-7vjv krb5kdc[25606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178917, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:37.502339 25991 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:48:37.503620 25991 webserver.cc:460] Webserver started at http://127.8.149.66:35001/ using document root <none> and password file <none>
I20260808 08:48:37.504328 25991 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:37.504434 25991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:37.504671 25991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:37.507426 25991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "fecab1079eef45d19179965cb9951763"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "aacfec5f1bd66d3a51926bcf2a449508"
server_key_iv: "49a79ec64adda36042f04bd9d0cca91d"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.508275 25991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "fecab1079eef45d19179965cb9951763"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "aacfec5f1bd66d3a51926bcf2a449508"
server_key_iv: "49a79ec64adda36042f04bd9d0cca91d"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.513602 25991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:48:37.517164 26016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.518429 25991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:48:37.518616 25991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "fecab1079eef45d19179965cb9951763"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "aacfec5f1bd66d3a51926bcf2a449508"
server_key_iv: "49a79ec64adda36042f04bd9d0cca91d"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.518838 25991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:37.532457 25991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:37.536423 25991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:37.536688 25991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:37.537669 25991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:37.539146 25991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:37.539259 25991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.539436 25991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:37.539515 25991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:37.572712 25991 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:37079
I20260808 08:48:37.572753 26185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:37079 every 8 connection(s)
I20260808 08:48:37.574100 25991 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:48:37.575609 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 25991
I20260808 08:48:37.575798 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:48:37.576339 8789 external_mini_cluster.cc:1428] Setting key 80e5c67531fc47107bb841e5006ebf22
Aug 08 08:48:37 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178917, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:37.596180 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:37.577168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:46321 (local address 127.8.149.126:33587)
0808 08:48:37.577407 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:37.577414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:37.578830 (+ 1416us) server_negotiation.cc:407] Connection header received
0808 08:48:37.580800 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:37.580808 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:37.580903 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:37.581015 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:37.582478 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.583589 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.585303 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.586034 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.586174 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:37.590044 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:37.590069 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:37.590074 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:37.590117 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:37.592967 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:37.593716 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:37.593726 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:37.593728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:37.593890 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:37.594382 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:37.594393 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:37.594396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:37.594684 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:37.594875 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:37.595545 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 08:48:37.595782 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:48:37.597055 26188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:37.577731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33587 (local address 127.8.149.66:46321)
0808 08:48:37.578648 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:37.578696 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:37.580523 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:37.581223 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:37.581231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:37.581750 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:37.582303 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:37.582320 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.583754 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.583758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:37.585152 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:37.585167 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:37.586264 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:37.586270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:37.586604 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:37.587354 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:37.587386 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:37.589813 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:37.593120 (+ 3307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:37.593129 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:37.593148 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:37.593586 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:37.594024 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:37.594030 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:37.594034 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:37.594237 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:37.594828 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:37.594836 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:37.595142 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 08:48:37.595430 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 08:48:37.595895 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":421,"threads_started":1}
I20260808 08:48:37.598502 26186 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33587
I20260808 08:48:37.598832 26186 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:37.599723 26186 heartbeater.cc:511] Master 127.8.149.126:33587 requested a full tablet report, sending...
I20260808 08:48:37.601390 25679 ts_manager.cc:194] Registered new tserver with Master: fecab1079eef45d19179965cb9951763 (127.8.149.66:37079)
I20260808 08:48:37.602272 25679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:46321
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:48:37.638792 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:48:37.952785 26192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:48:37.953022 26192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:48:37.953110 26192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:48:37.959698 26192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:48:37.959821 26192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:48:37.959955 26192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:48:37.970057 26192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:33587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:48:37.971223 26192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:48:37.972553 26192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:48:37.985397 26202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:37.985330 26203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:48:37.985565 26206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:48:37.986269 26192 server_base.cc:1034] running on GCE node
I20260808 08:48:37.986925 26192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:48:37.987797 26192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:48:37.989010 26192 hybrid_clock.cc:648] HybridClock initialized: now 1786178917988977 us; error 54 us; skew 500 ppm
I20260808 08:48:37.989323 26192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:48:37 dist-test-slave-7vjv krb5kdc[25606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178917, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:48:37.992784 26192 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:48:37.994239 26192 webserver.cc:460] Webserver started at http://127.8.149.67:38257/ using document root <none> and password file <none>
I20260808 08:48:37.994879 26192 fs_manager.cc:359] Metadata directory not provided
I20260808 08:48:37.995024 26192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:48:37.995393 26192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:48:37.998282 26192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "47c00da814804a1eb8fa9e70a9dfc60c"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "03489e20d764b13b2c1420d4cbb1bf8d"
server_key_iv: "4291eb1fb58a623bc5f7634a9985ab8c"
server_key_version: "encryptionkey@0"
I20260808 08:48:37.999136 26192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "47c00da814804a1eb8fa9e70a9dfc60c"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "03489e20d764b13b2c1420d4cbb1bf8d"
server_key_iv: "4291eb1fb58a623bc5f7634a9985ab8c"
server_key_version: "encryptionkey@0"
I20260808 08:48:38.004197 26192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:48:38.007337 26215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:38.008687 26192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:48:38.008873 26192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "47c00da814804a1eb8fa9e70a9dfc60c"
format_stamp: "Formatted at 2026-08-08 08:48:37 on dist-test-slave-7vjv"
server_key: "03489e20d764b13b2c1420d4cbb1bf8d"
server_key_iv: "4291eb1fb58a623bc5f7634a9985ab8c"
server_key_version: "encryptionkey@0"
I20260808 08:48:38.009073 26192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:48:38.037470 26192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:48:38.041611 26192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:48:38.041903 26192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:48:38.042770 26192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:48:38.043947 26192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:48:38.044015 26192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:38.044189 26192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:48:38.044252 26192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:48:38.079674 26192 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:45157
I20260808 08:48:38.079722 26390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:45157 every 8 connection(s)
I20260808 08:48:38.080952 26192 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:48:38.089716 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 26192
I20260808 08:48:38.089926 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:48:38.090324 8789 external_mini_cluster.cc:1428] Setting key 2962b40afd4e9b11063e0afee19b95a7
Aug 08 08:48:38 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178917, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:48:38.095147 25985 heartbeater.cc:503] Master 127.8.149.126:33587 was elected leader, sending a full tablet report...
I20260808 08:48:38.099781 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.083410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:59333 (local address 127.8.149.126:33587)
0808 08:48:38.083604 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.083608 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.084738 (+ 1130us) server_negotiation.cc:407] Connection header received
0808 08:48:38.086406 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.086411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.086514 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.086622 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:38.087976 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.088849 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.090423 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.090853 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.090981 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.094362 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:38.094366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:38.094369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:38.094402 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:38.097367 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.098004 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.098010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.098013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.098184 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.098527 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.098530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.098532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.098762 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:38.098857 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.099405 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.099542 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:48:38.100668 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.083882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:33587 (local address 127.8.149.67:59333)
0808 08:48:38.084584 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.084627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.086155 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.086833 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.086840 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.087293 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:48:38.087792 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.087807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.089024 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.089030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.090285 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.090297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.091116 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.091124 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.091345 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.092037 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:48:38.092077 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:48:38.094189 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:48:38.097479 (+ 3290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:38.097484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:38.097494 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:38.097880 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:38.098275 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:48:38.098278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:48:38.098280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:48:38.098443 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:48:38.098853 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:48:38.098857 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:48:38.099138 (+ 281us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.099328 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.099653 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":309,"threads_started":1}
I20260808 08:48:38.101809 26391 heartbeater.cc:347] Connected to a master server at 127.8.149.126:33587
I20260808 08:48:38.102099 26391 heartbeater.cc:464] Registering TS with master...
I20260808 08:48:38.102805 26391 heartbeater.cc:511] Master 127.8.149.126:33587 requested a full tablet report, sending...
I20260808 08:48:38.104377 25678 ts_manager.cc:194] Registered new tserver with Master: 47c00da814804a1eb8fa9e70a9dfc60c (127.8.149.67:45157)
I20260808 08:48:38.105324 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:48:38.105536 25678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:59333
I20260808 08:48:38.123571 25987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.110427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34548 (local address 127.8.149.126:33587)
0808 08:48:38.110592 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.110598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.111348 (+ 750us) server_negotiation.cc:407] Connection header received
0808 08:48:38.111595 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.111598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.111647 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.111715 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:38.113522 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.114178 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.115633 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.116054 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.116231 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.118818 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:38.118822 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:38.118825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:38.118849 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:38.121135 (+ 2286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.121698 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.121702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.121703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.121807 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.122232 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.122235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.122237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.122519 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:38.122704 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.123057 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.123243 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:48:38.127132 25678 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:48:38.133232 25678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:48:38.159574 26412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.144882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:45157 (local address 127.0.0.1:38018)
0808 08:48:38.145556 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.145596 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.145737 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.147581 (+ 1844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.147593 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.147640 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:38.148241 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.148261 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.151110 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.151120 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.154750 (+ 3630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.154787 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.157944 (+ 3157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.157956 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.158282 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.158364 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.158593 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.158921 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":311,"threads_started":1}
I20260808 08:48:38.160897 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.145264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38018 (local address 127.8.149.67:45157)
0808 08:48:38.146505 (+ 1241us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.146514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.146550 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:48:38.146661 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.146672 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.146928 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.147173 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:38.148529 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.150854 (+ 2325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.155065 (+ 4211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.157203 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.157392 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.157722 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.160001 (+ 2279us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.160296 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1080,"thread_start_us":909,"threads_started":1}
I20260808 08:48:38.166154 26290 tablet_service.cc:1467] Processing CreateTablet for tablet c7bb317839d44d3eba1d852cf406cc14 (DEFAULT_TABLE table=test-table [id=32ddaed2ba44428cbb0d20c19f356410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:38.167800 26290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7bb317839d44d3eba1d852cf406cc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:38.168401 26412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.146444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44436)
0808 08:48:38.161415 (+ 14971us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.161441 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.161614 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.162526 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.162532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.162559 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:38.162724 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.162735 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.164348 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.164353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.165649 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.165661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.167697 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.167703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.167862 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.167902 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.167992 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.168152 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14829,"thread_start_us":15013,"threads_started":1}
I20260808 08:48:38.169291 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.145997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:37079 (local address 127.0.0.1:55846)
0808 08:48:38.156683 (+ 10686us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.156704 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.156828 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.162828 (+ 6000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.162833 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.162855 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:38.163249 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.163262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.165416 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.165422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.166771 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.166783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.168471 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.168479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.168761 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.168783 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.168880 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.169000 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10498,"thread_start_us":10346,"threads_started":1}
I20260808 08:48:38.169385 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.146808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55846 (local address 127.8.149.66:37079)
0808 08:48:38.162066 (+ 15258us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.162074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.162101 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:48:38.162193 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.162203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.162414 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.162589 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:38.163435 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.165244 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.166971 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.168005 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.168149 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.168313 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.168931 (+ 618us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.169075 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15097,"thread_start_us":16343,"threads_started":1}
I20260808 08:48:38.170116 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.146693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44436 (local address 127.8.149.65:34543)
0808 08:48:38.161102 (+ 14409us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.161111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.161647 (+ 536us) server_negotiation.cc:407] Connection header received
0808 08:48:38.161792 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.161801 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.162080 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.162262 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:38.162913 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.164221 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.165836 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.167507 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.167653 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.167960 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.169498 (+ 1538us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.169710 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14231,"thread_start_us":14431,"threads_started":1}
I20260808 08:48:38.172571 26090 tablet_service.cc:1467] Processing CreateTablet for tablet c7bb317839d44d3eba1d852cf406cc14 (DEFAULT_TABLE table=test-table [id=32ddaed2ba44428cbb0d20c19f356410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:38.173847 26090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7bb317839d44d3eba1d852cf406cc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:38.173617 25881 tablet_service.cc:1467] Processing CreateTablet for tablet c7bb317839d44d3eba1d852cf406cc14 (DEFAULT_TABLE table=test-table [id=32ddaed2ba44428cbb0d20c19f356410]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:48:38.174993 25881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7bb317839d44d3eba1d852cf406cc14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:48:38.181389 26425 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Bootstrap starting.
I20260808 08:48:38.185189 26425 tablet_bootstrap.cc:654] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:38.186580 26425 log.cc:824] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:38.189105 26426 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Bootstrap starting.
I20260808 08:48:38.191809 26425 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: No bootstrap required, opened a new log
I20260808 08:48:38.192011 26428 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Bootstrap starting.
I20260808 08:48:38.192159 26425 ts_tablet_manager.cc:1397] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260808 08:48:38.192745 26426 tablet_bootstrap.cc:654] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:38.193693 26426 log.cc:824] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:38.196491 26428 tablet_bootstrap.cc:654] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Neither blocks nor log segments found. Creating new log.
I20260808 08:48:38.196657 26426 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: No bootstrap required, opened a new log
I20260808 08:48:38.196928 26426 ts_tablet_manager.cc:1397] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260808 08:48:38.197928 26428 log.cc:824] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Log is configured to *not* fsync() on all Append() calls
I20260808 08:48:38.200907 26428 tablet_bootstrap.cc:492] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: No bootstrap required, opened a new log
I20260808 08:48:38.201150 26428 ts_tablet_manager.cc:1397] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260808 08:48:38.202881 26425 raft_consensus.cc:348] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.203277 26425 raft_consensus.cc:374] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:38.203414 26425 raft_consensus.cc:729] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c00da814804a1eb8fa9e70a9dfc60c, State: Initialized, Role: FOLLOWER
I20260808 08:48:38.204241 26425 consensus_queue.cc:260] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.205547 26391 heartbeater.cc:503] Master 127.8.149.126:33587 was elected leader, sending a full tablet report...
I20260808 08:48:38.206248 26425 ts_tablet_manager.cc:1428] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260808 08:48:38.206852 26426 raft_consensus.cc:348] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.207279 26426 raft_consensus.cc:374] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:38.207376 26426 raft_consensus.cc:729] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecab1079eef45d19179965cb9951763, State: Initialized, Role: FOLLOWER
I20260808 08:48:38.208041 26426 consensus_queue.cc:260] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.211100 26426 ts_tablet_manager.cc:1428] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Time spent starting tablet: real 0.014s user 0.007s sys 0.007s
I20260808 08:48:38.211355 26186 heartbeater.cc:503] Master 127.8.149.126:33587 was elected leader, sending a full tablet report...
I20260808 08:48:38.213711 26428 raft_consensus.cc:348] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.214174 26428 raft_consensus.cc:374] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:48:38.214287 26428 raft_consensus.cc:729] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfe9ab0889d4e25b3fb44b8e56fc895, State: Initialized, Role: FOLLOWER
I20260808 08:48:38.214920 26428 consensus_queue.cc:260] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.216576 26428 ts_tablet_manager.cc:1428] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260808 08:48:38.244295 26435 raft_consensus.cc:482] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:48:38.244592 26435 raft_consensus.cc:504] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.246796 26435 leader_election.cc:288] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c00da814804a1eb8fa9e70a9dfc60c (127.8.149.67:45157), 8dfe9ab0889d4e25b3fb44b8e56fc895 (127.8.149.65:34543)
I20260808 08:48:38.257416 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.248658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:59787 (local address 127.8.149.65:34543)
0808 08:48:38.248877 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.248885 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.249253 (+ 368us) server_negotiation.cc:407] Connection header received
0808 08:48:38.249457 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.249464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.249550 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.249634 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:38.250407 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.251727 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.254346 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.256050 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.256334 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.256445 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.256855 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.257062 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:48:38.257428 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.248256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.8.149.66:59787)
0808 08:48:38.249153 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.249168 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.249314 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.249819 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.249822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.249850 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:38.250229 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.250243 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.251873 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.251878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.254158 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.254174 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.256359 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.256368 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.256627 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.256689 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.256812 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.256999 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"threads_started":1}
I20260808 08:48:38.259167 25911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7bb317839d44d3eba1d852cf406cc14" candidate_uuid: "fecab1079eef45d19179965cb9951763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" is_pre_election: true
I20260808 08:48:38.259694 25911 raft_consensus.cc:2454] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecab1079eef45d19179965cb9951763 in term 0.
I20260808 08:48:38.260412 26021 leader_election.cc:302] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfe9ab0889d4e25b3fb44b8e56fc895, fecab1079eef45d19179965cb9951763; no voters:
I20260808 08:48:38.260823 26435 raft_consensus.cc:2781] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:48:38.261059 26435 raft_consensus.cc:482] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:48:38.261282 26435 raft_consensus.cc:3037] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:38.263186 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.249444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:45855 (local address 127.8.149.67:45157)
0808 08:48:38.249658 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.249666 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.257760 (+ 8094us) server_negotiation.cc:407] Connection header received
0808 08:48:38.257910 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.257918 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.257998 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.258088 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:48:38.258612 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.259598 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.261332 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.262371 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.262563 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.262632 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.262869 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.262981 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:48:38.263229 26438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.248456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:45157 (local address 127.8.149.66:45855)
0808 08:48:38.257648 (+ 9192us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.257665 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:48:38.257775 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:48:38.258255 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:48:38.258260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:48:38.258282 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:48:38.258403 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.258409 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.259735 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.259740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.261186 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:48:38.261197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.262535 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.262541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:48:38.262727 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.262751 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:48:38.262846 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:48:38.262962 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9076,"thread_start_us":364,"threads_started":1}
I20260808 08:48:38.264348 26325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7bb317839d44d3eba1d852cf406cc14" candidate_uuid: "fecab1079eef45d19179965cb9951763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" is_pre_election: true
I20260808 08:48:38.264588 26435 raft_consensus.cc:504] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.264952 26325 raft_consensus.cc:2454] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecab1079eef45d19179965cb9951763 in term 0.
I20260808 08:48:38.265297 26435 leader_election.cc:288] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [CANDIDATE]: Term 1 election: Requested vote from peers 47c00da814804a1eb8fa9e70a9dfc60c (127.8.149.67:45157), 8dfe9ab0889d4e25b3fb44b8e56fc895 (127.8.149.65:34543)
I20260808 08:48:38.267733 26325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7bb317839d44d3eba1d852cf406cc14" candidate_uuid: "fecab1079eef45d19179965cb9951763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c00da814804a1eb8fa9e70a9dfc60c"
I20260808 08:48:38.267729 25911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7bb317839d44d3eba1d852cf406cc14" candidate_uuid: "fecab1079eef45d19179965cb9951763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895"
I20260808 08:48:38.267930 26325 raft_consensus.cc:3037] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:38.267937 25911 raft_consensus.cc:3037] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:48:38.270117 25911 raft_consensus.cc:2454] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecab1079eef45d19179965cb9951763 in term 1.
I20260808 08:48:38.270503 26021 leader_election.cc:302] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfe9ab0889d4e25b3fb44b8e56fc895, fecab1079eef45d19179965cb9951763; no voters:
I20260808 08:48:38.271755 26435 raft_consensus.cc:2781] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:48:38.271754 26325 raft_consensus.cc:2454] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecab1079eef45d19179965cb9951763 in term 1.
I20260808 08:48:38.272303 26435 raft_consensus.cc:686] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 1 LEADER]: Becoming Leader. State: Replica: fecab1079eef45d19179965cb9951763, State: Running, Role: LEADER
I20260808 08:48:38.272760 26435 consensus_queue.cc:237] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } }
I20260808 08:48:38.277726 25678 catalog_manager.cc:5495] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 reported cstate change: term changed from 0 to 1, leader changed from <none> to fecab1079eef45d19179965cb9951763 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "fecab1079eef45d19179965cb9951763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fecab1079eef45d19179965cb9951763" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 } health_report { overall_health: UNKNOWN } } }
I20260808 08:48:38.310456 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.304939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55862 (local address 127.8.149.66:37079)
0808 08:48:38.305132 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.305136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.305248 (+ 112us) server_negotiation.cc:407] Connection header received
0808 08:48:38.305415 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.305418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.305488 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.305606 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:48:38.305985 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.306755 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.308250 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.308708 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.308803 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.309361 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:48:38.309956 (+ 595us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:48:38.310071 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.310186 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.310250 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 08:48:38.317085 25986 tablet.cc:2369] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:48:38.319087 26325 raft_consensus.cc:1261] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 1 FOLLOWER]: Refusing update from remote peer fecab1079eef45d19179965cb9951763: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:38.319139 25911 raft_consensus.cc:1261] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 1 FOLLOWER]: Refusing update from remote peer fecab1079eef45d19179965cb9951763: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:48:38.320021 26440 consensus_queue.cc:1035] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfe9ab0889d4e25b3fb44b8e56fc895" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:48:38.320399 26435 consensus_queue.cc:1035] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c00da814804a1eb8fa9e70a9dfc60c" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:48:38.326603 26187 tablet.cc:2369] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:48:38.331938 26444 mvcc.cc:205] Tried to move back new op lower bound from 7316188849424777216 to 7316188849248989184. Current Snapshot: MvccSnapshot[applied={T|T < 7316188849424777216}]
W20260808 08:48:38.332485 26394 tablet.cc:2369] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:48:38.333184 26445 mvcc.cc:205] Tried to move back new op lower bound from 7316188849424777216 to 7316188849248989184. Current Snapshot: MvccSnapshot[applied={T|T < 7316188849424777216}]
I20260808 08:48:38.342621 26448 mvcc.cc:205] Tried to move back new op lower bound from 7316188849424777216 to 7316188849248989184. Current Snapshot: MvccSnapshot[applied={T|T < 7316188849424777216 or (T in {7316188849424777216})}]
I20260808 08:48:38.349334 25678 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:38.349601 25678 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:48:38.352923 25678 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a4cc8857834481686398e777b96a594: Sending DeleteTablet for 3 replicas of tablet c7bb317839d44d3eba1d852cf406cc14
I20260808 08:48:38.354027 26290 tablet_service.cc:1514] Processing DeleteTablet for tablet c7bb317839d44d3eba1d852cf406cc14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:38 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:38018
I20260808 08:48:38.354178 26090 tablet_service.cc:1514] Processing DeleteTablet for tablet c7bb317839d44d3eba1d852cf406cc14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:38 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:55846
I20260808 08:48:38.354221 25881 tablet_service.cc:1514] Processing DeleteTablet for tablet c7bb317839d44d3eba1d852cf406cc14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:48:38 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:44436
I20260808 08:48:38.356468 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 25782
I20260808 08:48:38.367326 26458 tablet_replica.cc:330] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: stopping tablet replica
I20260808 08:48:38.367851 26458 raft_consensus.cc:2229] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:38.368508 26458 raft_consensus.cc:2258] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:38.370811 26458 ts_tablet_manager.cc:1905] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:38.374385 26461 tablet_replica.cc:330] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: stopping tablet replica
I20260808 08:48:38.374810 26461 raft_consensus.cc:2229] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:48:38.375327 26461 raft_consensus.cc:2258] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:38.376470 26459 tablet_replica.cc:330] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: stopping tablet replica
I20260808 08:48:38.376886 26459 raft_consensus.cc:2229] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 1 LEADER]: Raft consensus shutting down.
Aug 08 08:48:38 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:48:38.377578 26461 ts_tablet_manager.cc:1905] T c7bb317839d44d3eba1d852cf406cc14 P 8dfe9ab0889d4e25b3fb44b8e56fc895: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:38.377545 26459 raft_consensus.cc:2258] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:48:38.379462 26459 ts_tablet_manager.cc:1905] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:48:38.384675 26423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.359871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.8.149.65:34543)
0808 08:48:38.360126 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.360134 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.365025 (+ 4891us) server_negotiation.cc:407] Connection header received
0808 08:48:38.365250 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.365259 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.365363 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.365482 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:38.367763 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.369324 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.371944 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.372813 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.372959 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.378559 (+ 5600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:38.378570 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:38.378581 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:38.378617 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:38.381863 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.382525 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.382533 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.382537 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.382661 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.383078 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.383084 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.383087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.383444 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:38.383770 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.384073 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.384295 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:48:38.385430 25978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:38.389755 26458 ts_tablet_manager.cc:1918] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:38.389971 26458 log.cc:1196] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/c7bb317839d44d3eba1d852cf406cc14
I20260808 08:48:38.390563 26458 ts_tablet_manager.cc:1939] T c7bb317839d44d3eba1d852cf406cc14 P 47c00da814804a1eb8fa9e70a9dfc60c: Deleting consensus metadata
I20260808 08:48:38.392416 26459 ts_tablet_manager.cc:1918] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:48:38.392583 26459 log.cc:1196] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/c7bb317839d44d3eba1d852cf406cc14
I20260808 08:48:38.392668 25655 catalog_manager.cc:4841] TS 47c00da814804a1eb8fa9e70a9dfc60c (127.8.149.67:45157): tablet c7bb317839d44d3eba1d852cf406cc14 (table test-table [id=32ddaed2ba44428cbb0d20c19f356410]) successfully deleted
I20260808 08:48:38.393188 26459 ts_tablet_manager.cc:1939] T c7bb317839d44d3eba1d852cf406cc14 P fecab1079eef45d19179965cb9951763: Deleting consensus metadata
I20260808 08:48:38.394387 25655 catalog_manager.cc:4841] TS fecab1079eef45d19179965cb9951763 (127.8.149.66:37079): tablet c7bb317839d44d3eba1d852cf406cc14 (table test-table [id=32ddaed2ba44428cbb0d20c19f356410]) successfully deleted
I20260808 08:48:38.492838 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 25782
I20260808 08:48:38.526815 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 25991
W20260808 08:48:38.526865 25654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.149.65:34543 (error 108)
I20260808 08:48:38.529009 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.528500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44458)
0808 08:48:38.528673 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.528792 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 08:48:38.530088 25654 catalog_manager.cc:4584] TS 8dfe9ab0889d4e25b3fb44b8e56fc895 (127.8.149.65:34543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c7bb317839d44d3eba1d852cf406cc14: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Aug 08 08:48:38 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:48:38.544601 26424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.527946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.8.149.66:37079)
0808 08:48:38.528139 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.528145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.528171 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:48:38.528379 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.528385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.528467 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.528609 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:38.530044 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.531289 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.532597 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.533283 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.533408 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.537596 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:38.537610 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:38.537628 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:38.537672 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:38.541666 (+ 3994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.542406 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.542415 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.542419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.542598 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.542998 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.543003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.543006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.543472 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:38.543816 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.544001 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.544236 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:48:38.545312 26178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:38.583684 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.583156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44462)
0808 08:48:38.583412 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.583511 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 08:48:38.584774 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.584387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44468)
0808 08:48:38.584547 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.584628 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:48:38.645427 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.644859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44480)
0808 08:48:38.645106 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.645213 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 08:48:38.646617 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.646231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44488)
0808 08:48:38.646402 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.646486 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 08:48:38.652279 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 25991
I20260808 08:48:38.679251 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 26192
Aug 08 08:48:38 dist-test-slave-7vjv krb5kdc[25606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:48:38.693961 26413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.680007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38030 (local address 127.8.149.67:45157)
0808 08:48:38.680206 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:48:38.680213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:48:38.680255 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:48:38.680492 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:48:38.680515 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:48:38.680581 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:48:38.680687 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:48:38.682027 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.682766 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.684047 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:48:38.684531 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:48:38.684674 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:48:38.688967 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:48:38.688980 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:48:38.688996 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:48:38.689029 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:48:38.691584 (+ 2555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.692270 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.692279 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.692281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.692413 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:48:38.692753 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:48:38.692756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:48:38.692758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:48:38.693090 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:48:38.693307 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:48:38.693523 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 08:48:38.693681 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:48:38.694581 26386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:38.727095 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.726585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44502)
0808 08:48:38.726782 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.726885 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:48:38.728334 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:48:38.727831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34543 (local address 127.0.0.1:44504)
0808 08:48:38.728067 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:48:38.728172 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:34543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260808 08:48:38.782065 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 26192
I20260808 08:48:38.806690 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 25625
I20260808 08:48:38.808027 25742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:48:38.916975 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 25625
2026-08-08T08:48:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4424 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:48:39 dist-test-slave-7vjv krb5kdc[26476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:48:39 dist-test-slave-7vjv krb5kdc[26476](info): set up 2 sockets
Aug 08 08:48:39 dist-test-slave-7vjv krb5kdc[26476](info): commencing operation
krb5kdc: starting...
W20260808 08:48:40.229764 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:48:40 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:48:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:48:40Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangeradmin_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangeradmin_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangerlookup_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangerlookup_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
I20260808 08:48:40.571116 8789 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task4pJ3L_/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/postgres -l logfile start
2026-08-08 08:48:43.042 UTC [26519] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:48:43.042 UTC [26519] LOG: listening on IPv4 address "127.8.149.84", port 51351
2026-08-08 08:48:43.046 UTC [26519] LOG: listening on Unix socket "/tmp/.s.PGSQL.51351"
2026-08-08 08:48:43.070 UTC [26524] LOG: database system was shut down at 2026-08-08 08:48:41 UTC
2026-08-08 08:48:43.073 UTC [26519] LOG: database system is ready to accept connections
I20260808 08:48:44.271755 8789 mini_postgres.cc:96] Postgres bound to 51351
2026-08-08 08:48:44.298 UTC [26534] FATAL: database "slave" does not exist
127.8.149.84:51351 - accepting connections
I20260808 08:48:44.299810 8789 mini_ranger.cc:161] Starting Ranger...
I20260808 08:48:44.331025 8789 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:48:44.789109 8789 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:48:44.789273 8789 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin
2026-08-08 08:48:45,135 [I] DB FLAVOR :POSTGRES
2026-08-08 08:48:45,136 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:48:45,136 [I] Checking connection..
2026-08-08 08:48:45,136 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:48:45,370 [I] Checking connection passed.
2026-08-08 08:48:45,370 [I] --------- Verifying version history table ---------
2026-08-08 08:48:45,370 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:48:45,628 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:48:45,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:48:45,857 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:48:45,857 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:48:45,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:48:46.098 UTC [26634] WARNING: there is no transaction in progress
2026-08-08 08:48:46,107 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:48:46,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:48:46,361 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:48:46,361 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:48:46,362 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:48:46,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:48:46,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7vjv.c.gcp-upstream.internal','N') ;"
2026-08-08 08:48:47,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:48:47,394 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:48:47,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:48:47,660 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:48:47,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:48:47,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:48:48,160 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:48:48,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:48:49.080 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.096 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.112 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.127 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.145 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.161 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.213 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.220 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.234 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.244 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.253 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.266 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.276 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.282 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.289 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49.295 UTC [26812] WARNING: there is no transaction in progress
2026-08-08 08:48:49,916 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:48:49,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:48:50,149 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:48:50,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:48:50,402 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:48:50,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:48:50,671 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:48:50,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:48:50,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:48:51,160 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7vjv.c.gcp-upstream.internal';"
2026-08-08 08:48:51,406 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:48:51,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:48:51,663 [I] DB_PATCHES have already been applied
I20260808 08:48:51.669004 8789 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task4pJ3L_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:48:51.669090 8789 mini_ranger.cc:193] Using host: 127.8.149.84
I20260808 08:48:51.690603 8789 mini_ranger.cc:227] Ranger admin URL: http://127.8.149.84:48559
Aug 08, 2026 8:48:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:48:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:48:53.047266 8789 mini_ranger.cc:160] Time spent starting Ranger: real 8.748s user 0.000s sys 0.061s
Aug 08, 2026 8:49:12 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:49:12 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 8:49:12 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:49:12 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:49:13 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:49:14.200526 8789 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangerkms_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/rangerkms_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.149.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.149.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:49:14 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178954, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:49:14.404336 8789 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:49:14.431026 8789 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:49:15.255656 8789 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:49:15.255829 8789 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms
I20260808 08:49:15.255975 8789 mini_ranger_kms.cc:227] Using postgres at 127.8.149.84:51351
2026-08-08 08:49:15,836 [I] DB FLAVOR :POSTGRES
2026-08-08 08:49:15,836 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:49:15,836 [I] Checking connection
2026-08-08 08:49:15,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:49:16,070 [I] connection success
2026-08-08 08:49:16,070 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:49:16,071 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:49:16,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:49:16,301 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:49:16,301 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:49:16,301 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:49:16,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:51351/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:49:16,553 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:49:16.998066 8789 mini_ranger_kms.cc:310] Created kms service
I20260808 08:49:17.188771 8789 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:49:17.232523 8789 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:49:17 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178954, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:17.629762 8789 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:49:17.631095 8789 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms:/tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:49:17.631172 8789 mini_ranger_kms.cc:240] Using host: 127.8.149.84
I20260808 08:49:17.662635 8789 mini_ranger_kms.cc:276] Ranger KMS PID: 27098
I20260808 08:49:17.662807 8789 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.149.84:57143
Aug 08, 2026 8:49:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:49:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:49:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:49:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:49:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:49:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 08:49:19 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178959, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:49:20.374480 8789 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.970s user 0.136s sys 0.451s
I20260808 08:49:20.374836 8789 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:49:20.375053 8789 mini_ranger_kms.cc:401] 127.8.149.84:57143/kms/v1/keys
Aug 08 08:49:20 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178959, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
Aug 08 08:49:20 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178959, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
Aug 08 08:49:23 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:49:23.097865 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40733
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40733
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:57143/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:49:23.496518 27184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:49:23.496816 27184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:49:23.497033 27184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:49:23.505364 27184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:49:23.505528 27184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:49:23.505673 27184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:49:23.505825 27184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:49:23.505950 27184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:49:23.516157 27184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.149.84:57143/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40733
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:49:23.517381 27184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:49:23.518637 27184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:49:23.530579 27197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:23.530699 27201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:23.530664 27199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:49:23.531005 27184 server_base.cc:1034] running on GCE node
I20260808 08:49:23.532075 27184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:49:23.533339 27184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:49:23.534559 27184 hybrid_clock.cc:648] HybridClock initialized: now 1786178963534523 us; error 32 us; skew 500 ppm
I20260808 08:49:23.534904 27184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:49:23 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:49:23.540445 27184 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:49:23.541805 27184 webserver.cc:460] Webserver started at http://127.8.149.126:39369/ using document root <none> and password file <none>
I20260808 08:49:23.542472 27184 fs_manager.cc:359] Metadata directory not provided
I20260808 08:49:23.542618 27184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:49:23.542899 27184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:49:23 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:23.600812 27184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "e056a52d0b4640ad8a32afb064d5ab95"
format_stamp: "Formatted at 2026-08-08 08:49:23 on dist-test-slave-7vjv"
server_key: "2f2033a5789bedc244072b3f030e3b4c"
server_key_iv: "22bb878cb407a6124eb05bf9a8795baa"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:23.601837 27184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "e056a52d0b4640ad8a32afb064d5ab95"
format_stamp: "Formatted at 2026-08-08 08:49:23 on dist-test-slave-7vjv"
server_key: "2f2033a5789bedc244072b3f030e3b4c"
server_key_iv: "22bb878cb407a6124eb05bf9a8795baa"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:23.607671 27184 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 08:49:23.626542 27212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:23.628003 27184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:49:23.628211 27184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "e056a52d0b4640ad8a32afb064d5ab95"
format_stamp: "Formatted at 2026-08-08 08:49:23 on dist-test-slave-7vjv"
server_key: "2f2033a5789bedc244072b3f030e3b4c"
server_key_iv: "22bb878cb407a6124eb05bf9a8795baa"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:23.628408 27184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:49:23.655488 27184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:49:23.659284 27184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:49:23.659600 27184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:49:23.689697 27184 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40733
I20260808 08:49:23.689836 27296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40733 every 8 connection(s)
I20260808 08:49:23.691216 27184 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:49:23.694929 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 27184
I20260808 08:49:23.695175 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:49:23.696170 8789 external_mini_cluster.cc:1428] Setting key 050a198f52b1c7e86e2d011529241166
I20260808 08:49:23.697009 27297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:49:23 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:49:23.715446 27297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: Bootstrap starting.
I20260808 08:49:23.720306 27297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: Neither blocks nor log segments found. Creating new log.
I20260808 08:49:23.722749 27297 log.cc:824] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: Log is configured to *not* fsync() on all Append() calls
I20260808 08:49:23.724244 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:23.698862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.8.149.126:40733)
0808 08:49:23.700041 (+ 1179us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:23.700053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:23.700165 (+ 112us) server_negotiation.cc:407] Connection header received
0808 08:49:23.703038 (+ 2873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:23.703057 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:23.703429 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:23.703796 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:23.705231 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:23.706779 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:23.708072 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:23.708807 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:23.708990 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:23.714371 (+ 5381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:23.714381 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:23.714414 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:23.714448 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:23.718256 (+ 3808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:23.718864 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:23.718875 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:23.718880 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:23.719053 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:23.719571 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:23.719577 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:23.719581 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:23.720623 (+ 1042us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:23.721218 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:23.721668 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 08:49:23.722073 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":953,"thread_start_us":690,"threads_started":1}
I20260808 08:49:23.727614 27297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: No bootstrap required, opened a new log
I20260808 08:49:23.738325 27297 raft_consensus.cc:348] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } }
I20260808 08:49:23.738838 27297 raft_consensus.cc:374] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:49:23.739019 27297 raft_consensus.cc:729] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e056a52d0b4640ad8a32afb064d5ab95, State: Initialized, Role: FOLLOWER
I20260808 08:49:23.739840 27297 consensus_queue.cc:260] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } }
I20260808 08:49:23.740247 27297 raft_consensus.cc:388] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:49:23.740489 27297 raft_consensus.cc:482] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:49:23.740841 27297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:49:23.743700 27297 raft_consensus.cc:504] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } }
I20260808 08:49:23.744324 27297 leader_election.cc:302] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e056a52d0b4640ad8a32afb064d5ab95; no voters:
I20260808 08:49:23.745251 27297 leader_election.cc:288] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:49:23.745462 27307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:49:23.746798 27307 raft_consensus.cc:686] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [term 1 LEADER]: Becoming Leader. State: Replica: e056a52d0b4640ad8a32afb064d5ab95, State: Running, Role: LEADER
I20260808 08:49:23.747419 27307 consensus_queue.cc:237] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } }
I20260808 08:49:23.747900 27297 sys_catalog.cc:564] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:49:23.751449 27308 sys_catalog.cc:455] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e056a52d0b4640ad8a32afb064d5ab95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } } }
I20260808 08:49:23.751362 27309 sys_catalog.cc:455] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e056a52d0b4640ad8a32afb064d5ab95. Latest consensus state: current_term: 1 leader_uuid: "e056a52d0b4640ad8a32afb064d5ab95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e056a52d0b4640ad8a32afb064d5ab95" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40733 } } }
I20260808 08:49:23.752190 27308 sys_catalog.cc:458] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [sys.catalog]: This master's current role is: LEADER
I20260808 08:49:23.752224 27309 sys_catalog.cc:458] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95 [sys.catalog]: This master's current role is: LEADER
I20260808 08:49:23.753499 27314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:49:23.761951 27314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:49:23.767194 27297 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:49:23.787168 27314 catalog_manager.cc:1347] Generated new cluster ID: 120a6a7673cf479e83295589ada77671
I20260808 08:49:23.787356 27314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:49:23.825796 27314 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:49:23.828290 27314 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:49:23.843993 27314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: Generated new TSK 0
I20260808 08:49:23.845316 27314 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:49:24.630610 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:57143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:49:24 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178964, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:49:25.164784 27366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:49:25.165271 27366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:49:25.165508 27366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:49:25.173436 27366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:49:25.173574 27366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:49:25.173727 27366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:49:25.186288 27366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.149.84:57143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:49:25.188212 27366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:49:25.190107 27366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:49:25.210469 27378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:25.215099 27381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:25.227993 27386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:49:25.229135 27366 server_base.cc:1034] running on GCE node
I20260808 08:49:25.229954 27366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:49:25.232416 27366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:49:25.233753 27366 hybrid_clock.cc:648] HybridClock initialized: now 1786178965233637 us; error 104 us; skew 500 ppm
I20260808 08:49:25.234273 27366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:49:25 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178965, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:49:25.240147 27366 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:49:25.248329 27366 webserver.cc:460] Webserver started at http://127.8.149.65:40487/ using document root <none> and password file <none>
I20260808 08:49:25.249462 27366 fs_manager.cc:359] Metadata directory not provided
I20260808 08:49:25.249684 27366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:49:25.250247 27366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:49:25 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178965, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:25.275722 27366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "49523797a7fc4a548f181828dcc3f568"
format_stamp: "Formatted at 2026-08-08 08:49:25 on dist-test-slave-7vjv"
server_key: "0821a0050c6266868c68fa60f7c99189"
server_key_iv: "e2f7dff5b706d64a5cb1fd3dd0f8e175"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:25.277349 27366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "49523797a7fc4a548f181828dcc3f568"
format_stamp: "Formatted at 2026-08-08 08:49:25 on dist-test-slave-7vjv"
server_key: "0821a0050c6266868c68fa60f7c99189"
server_key_iv: "e2f7dff5b706d64a5cb1fd3dd0f8e175"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:25.291613 27366 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.000s sys 0.012s
I20260808 08:49:25.320626 27398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:25.322383 27366 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.010s sys 0.002s
I20260808 08:49:25.322613 27366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "49523797a7fc4a548f181828dcc3f568"
format_stamp: "Formatted at 2026-08-08 08:49:25 on dist-test-slave-7vjv"
server_key: "0821a0050c6266868c68fa60f7c99189"
server_key_iv: "e2f7dff5b706d64a5cb1fd3dd0f8e175"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:25.322945 27366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:49:25.378005 27366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:49:25.384724 27366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:49:25.385306 27366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:49:25.393195 27366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:49:25.401703 27366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:49:25.401847 27366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:25.402091 27366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:49:25.402262 27366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:49:25 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178964, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:25.655936 27366 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:35503
I20260808 08:49:25.656180 27572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:35503 every 8 connection(s)
I20260808 08:49:25.657799 27366 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:49:25.664209 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 27366
I20260808 08:49:25.664417 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:49:25.665266 8789 external_mini_cluster.cc:1428] Setting key 220b8a2f26484caca642d04adde3bba3
Aug 08 08:49:25 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178965, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:49:25.719112 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:25.663052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40733 (local address 127.8.149.65:38239)
0808 08:49:25.687752 (+ 24700us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:25.687816 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:25.693024 (+ 5208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:25.696188 (+ 3164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:25.696201 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:25.696907 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:49:25.697944 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:25.697969 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:25.699404 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:25.699408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:25.701586 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:25.701632 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:25.703195 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:25.703220 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:25.703588 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:25.704487 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:49:25.704525 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:49:25.708333 (+ 3808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:49:25.713664 (+ 5331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:25.713672 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:25.713701 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:25.714452 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:25.715006 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:25.715010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:25.715013 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:25.715369 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:25.716197 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:49:25.716204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:49:25.716687 (+ 483us) client_negotiation.cc:769] Sending connection context
0808 08:49:25.717000 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 08:49:25.717558 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24327,"thread_start_us":24960,"threads_started":1}
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
I20260808 08:49:25.720551 27578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:25.663952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:38239 (local address 127.8.149.126:40733)
0808 08:49:25.694430 (+ 30478us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:25.694445 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:25.694483 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:49:25.694579 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:25.694594 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:25.694747 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:25.694866 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:25.698143 (+ 3277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:25.699227 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:25.701805 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:25.702647 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:25.702822 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:25.708666 (+ 5844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:25.708673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:25.708678 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:25.708725 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:25.713484 (+ 4759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:25.714598 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:25.714604 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:25.714607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:25.714853 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:25.715555 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:25.715560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:25.715563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:25.715953 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:25.716121 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:25.719731 (+ 3610us) server_negotiation.cc:299] Negotiation successful
0808 08:49:25.719953 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30192,"thread_start_us":34098,"threads_started":1}
I20260808 08:49:25.722736 27573 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
I20260808 08:49:25.723237 27573 heartbeater.cc:464] Registering TS with master...
I20260808 08:49:25.724540 27573 heartbeater.cc:511] Master 127.8.149.126:40733 requested a full tablet report, sending...
I20260808 08:49:25.728057 27243 ts_manager.cc:194] Registered new tserver with Master: 49523797a7fc4a548f181828dcc3f568 (127.8.149.65:35503)
I20260808 08:49:25.730885 27243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:38239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:49:25.763449 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:57143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:49:25 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178964, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
W20260808 08:49:26.280146 27582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:49:26.280439 27582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:49:26.280540 27582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:49:26.287451 27582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:49:26.287547 27582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:49:26.287662 27582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:49:26.297395 27582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.149.84:57143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:49:26.298513 27582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:49:26.299700 27582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:49:26.312760 27607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:26.312809 27609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:26.312847 27611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:49:26.313920 27582 server_base.cc:1034] running on GCE node
I20260808 08:49:26.314513 27582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:49:26.315461 27582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:49:26.316681 27582 hybrid_clock.cc:648] HybridClock initialized: now 1786178966316639 us; error 55 us; skew 500 ppm
I20260808 08:49:26.316994 27582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:49:26 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178966, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:49:26.320349 27582 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:49:26.321805 27582 webserver.cc:460] Webserver started at http://127.8.149.66:44919/ using document root <none> and password file <none>
I20260808 08:49:26.322463 27582 fs_manager.cc:359] Metadata directory not provided
I20260808 08:49:26.322610 27582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:49:26.322935 27582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:49:26 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178966, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:26.340147 27582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "3a87f24d55de4fde831499d927e68f36"
format_stamp: "Formatted at 2026-08-08 08:49:26 on dist-test-slave-7vjv"
server_key: "14614b410b1fe5100ef65060860ab63c"
server_key_iv: "c59080e039fe759513dbf876926cc403"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:26.341315 27582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "3a87f24d55de4fde831499d927e68f36"
format_stamp: "Formatted at 2026-08-08 08:49:26 on dist-test-slave-7vjv"
server_key: "14614b410b1fe5100ef65060860ab63c"
server_key_iv: "c59080e039fe759513dbf876926cc403"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:26.348619 27582 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.003s
I20260808 08:49:26.363528 27624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:26.365332 27582 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260808 08:49:26.365571 27582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "3a87f24d55de4fde831499d927e68f36"
format_stamp: "Formatted at 2026-08-08 08:49:26 on dist-test-slave-7vjv"
server_key: "14614b410b1fe5100ef65060860ab63c"
server_key_iv: "c59080e039fe759513dbf876926cc403"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:26.365875 27582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:49:26.391110 27582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:49:26.395900 27582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:49:26.396255 27582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:49:26.397460 27582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:49:26.399111 27582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:49:26.399253 27582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:26.399466 27582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:49:26.399544 27582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:26.451608 27582 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:41167
I20260808 08:49:26.451704 27813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:41167 every 8 connection(s)
I20260808 08:49:26.453075 27582 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:49:26.453625 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 27582
I20260808 08:49:26.453794 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:49:26.454344 8789 external_mini_cluster.cc:1428] Setting key 3e4b616b2135cf3a24dc7a4aac209c16
Aug 08 08:49:26 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178966, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:49:26.481015 27822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:26.456698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:54315 (local address 127.8.149.126:40733)
0808 08:49:26.457692 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:26.457699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:26.459199 (+ 1500us) server_negotiation.cc:407] Connection header received
0808 08:49:26.461602 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:26.461608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:26.461701 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:26.461848 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:26.463930 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:26.464966 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:26.466805 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:26.467330 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:26.467477 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:26.472469 (+ 4992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:26.472476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:26.472480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:26.472539 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:26.476717 (+ 4178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:26.477794 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:26.477799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:26.477802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:26.477978 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:26.478661 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:26.478666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:26.478668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:26.479081 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:26.479257 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:26.480275 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0808 08:49:26.480520 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":875,"thread_start_us":1036,"threads_started":1}
I20260808 08:49:26.482642 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:26.457561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40733 (local address 127.8.149.66:54315)
0808 08:49:26.459024 (+ 1463us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:26.459079 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:26.461306 (+ 2227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:26.462136 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:26.462145 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:26.462777 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:49:26.463707 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:26.463728 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:26.465175 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:26.465181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:26.466626 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:26.466650 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:26.467593 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:26.467612 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:26.467951 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:26.468808 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:49:26.468830 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:49:26.472196 (+ 3366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:49:26.476866 (+ 4670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:26.476878 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:26.476895 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:26.477657 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:26.478111 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:26.478119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:26.478125 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:26.478533 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:26.479273 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:49:26.479300 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:49:26.479809 (+ 509us) client_negotiation.cc:769] Sending connection context
0808 08:49:26.480170 (+ 361us) client_negotiation.cc:240] Negotiation successful
0808 08:49:26.480878 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1144,"thread_start_us":829,"threads_started":1}
I20260808 08:49:26.484282 27817 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40733
I20260808 08:49:26.484608 27817 heartbeater.cc:464] Registering TS with master...
I20260808 08:49:26.485487 27817 heartbeater.cc:511] Master 127.8.149.126:40733 requested a full tablet report, sending...
I20260808 08:49:26.487686 27243 ts_manager.cc:194] Registered new tserver with Master: 3a87f24d55de4fde831499d927e68f36 (127.8.149.66:41167)
I20260808 08:49:26.489316 27243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:54315
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:49:26.528134 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:57143/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:49:26.735285 27573 heartbeater.cc:503] Master 127.8.149.126:40733 was elected leader, sending a full tablet report...
W20260808 08:49:26.972474 27826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:49:26.972786 27826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:49:26.973002 27826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:49:26.979924 27826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:49:26.980073 27826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:49:26.980278 27826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:49:26.990134 27826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.149.84:57143/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:49:26.991402 27826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:49:26.992743 27826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:49:27.005755 27835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:27.006256 27839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:49:27.006258 27834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:49:27.006793 27826 server_base.cc:1034] running on GCE node
I20260808 08:49:27.007395 27826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:49:27.008363 27826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:49:27.009613 27826 hybrid_clock.cc:648] HybridClock initialized: now 1786178967009570 us; error 48 us; skew 500 ppm
I20260808 08:49:27.009961 27826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178967, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:49:27.013594 27826 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:49:27.015204 27826 webserver.cc:460] Webserver started at http://127.8.149.67:36407/ using document root <none> and password file <none>
I20260808 08:49:27.015983 27826 fs_manager.cc:359] Metadata directory not provided
I20260808 08:49:27.016160 27826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:49:27.016502 27826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178967, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:49:27.032503 27826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b"
format_stamp: "Formatted at 2026-08-08 08:49:27 on dist-test-slave-7vjv"
server_key: "06b5c37552c508d426d7abf4e8211f28"
server_key_iv: "86e7cd9041166333d88937d22956afe9"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:27.033282 27826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b"
format_stamp: "Formatted at 2026-08-08 08:49:27 on dist-test-slave-7vjv"
server_key: "06b5c37552c508d426d7abf4e8211f28"
server_key_iv: "86e7cd9041166333d88937d22956afe9"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:27.038638 27826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:49:27.053493 27848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:27.054811 27826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:49:27.054999 27826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b"
format_stamp: "Formatted at 2026-08-08 08:49:27 on dist-test-slave-7vjv"
server_key: "06b5c37552c508d426d7abf4e8211f28"
server_key_iv: "86e7cd9041166333d88937d22956afe9"
server_key_version: "kuduclusterkey@0"
I20260808 08:49:27.055179 27826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:49:27.089236 27826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:49:27.093108 27826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:49:27.093420 27826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:49:27.094372 27826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:49:27.095808 27826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:49:27.095880 27826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:27.096040 27826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:49:27.096144 27826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:49:27.151485 27826 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:33591
I20260808 08:49:27.151528 28025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:33591 every 8 connection(s)
I20260808 08:49:27.153087 27826 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:49:27.158192 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 27826
I20260808 08:49:27.158370 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:49:27.159121 8789 external_mini_cluster.cc:1428] Setting key 2c9fe95f78ef22fe0cfd81dec20b3502
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178967, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:49:27.178395 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.156110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:48929 (local address 127.8.149.126:40733)
0808 08:49:27.156912 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.156916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.158433 (+ 1517us) server_negotiation.cc:407] Connection header received
0808 08:49:27.161297 (+ 2864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.161302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.161456 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.161543 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:27.163488 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.164378 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.166155 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.166690 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.166783 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.170453 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:27.170458 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:27.170461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:27.170494 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:27.174594 (+ 4100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.175415 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.175422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.175425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.175608 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.176211 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.176217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.176220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.176536 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:27.176699 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.177467 (+ 768us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.177778 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":416,"threads_started":1}
I20260808 08:49:27.179426 28032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.156764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40733 (local address 127.8.149.67:48929)
0808 08:49:27.158058 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.158122 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.160973 (+ 2851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.161873 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.161920 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.162361 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:49:27.163339 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.163358 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.164540 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.164543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.165955 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.165967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.166948 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.166953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.167175 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.167763 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:49:27.167781 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:49:27.170194 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:49:27.174777 (+ 4583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:27.174791 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:27.174800 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:27.175291 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:27.175726 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:49:27.175731 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:49:27.175735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:49:27.176040 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:49:27.176673 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:49:27.176680 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:49:27.177063 (+ 383us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.177335 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.177997 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":567,"threads_started":1}
I20260808 08:49:27.180804 28026 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40733
I20260808 08:49:27.181209 28026 heartbeater.cc:464] Registering TS with master...
I20260808 08:49:27.182263 28026 heartbeater.cc:511] Master 127.8.149.126:40733 requested a full tablet report, sending...
I20260808 08:49:27.183810 27243 ts_manager.cc:194] Registered new tserver with Master: f5bc6f8b3e5b40039d8ddb6fd84ee77b (127.8.149.67:33591)
I20260808 08:49:27.184897 27243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:48929
I20260808 08:49:27.187458 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:49:27.208582 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.193037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.8.149.126:40733)
0808 08:49:27.193184 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.193188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.194030 (+ 842us) server_negotiation.cc:407] Connection header received
0808 08:49:27.194205 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.194208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.194313 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.194386 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:27.196532 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.197370 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.199134 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.199629 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.199807 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.202638 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:27.202642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:27.202645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:27.202673 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:27.205779 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.206511 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.206518 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.206525 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.206638 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.207039 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.207043 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.207046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.207292 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:27.207643 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.207994 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.208250 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:49:27.213384 27243 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:49:27.222844 27243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:49:27.249128 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.237707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:41167 (local address 127.0.0.1:38076)
0808 08:49:27.239692 (+ 1985us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.239734 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.239992 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.241334 (+ 1342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.241343 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.241415 (+ 72us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:49:27.242200 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.242218 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.243753 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.243762 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.246487 (+ 2725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.246500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.248007 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.248014 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.248275 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.248337 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.248486 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.248662 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1640,"mutex_wait_us":22,"spinlock_wait_cycles":5376,"thread_start_us":1437,"threads_started":1}
I20260808 08:49:27.250247 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.238007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.8.149.66:41167)
0808 08:49:27.238927 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.238940 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.240223 (+ 1283us) server_negotiation.cc:407] Connection header received
0808 08:49:27.240330 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.240352 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.240607 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.240844 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:49:27.242454 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.243612 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.246649 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.247736 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.249356 (+ 1620us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.249545 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.249628 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.249836 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":487,"threads_started":1}
I20260808 08:49:27.250659 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.240145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35503 (local address 127.0.0.1:46594)
0808 08:49:27.242266 (+ 2121us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.242287 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.242382 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.243211 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.243215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.243236 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:49:27.243562 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.243570 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.245460 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.245468 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.247459 (+ 1991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.247473 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.249745 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.249752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.249950 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.249993 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.250103 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.250269 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2005,"mutex_wait_us":3,"thread_start_us":1863,"threads_started":1}
I20260808 08:49:27.250890 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.240569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46594 (local address 127.8.149.65:35503)
0808 08:49:27.242805 (+ 2236us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.242810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.242841 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:49:27.242911 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.242915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.243037 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.243220 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:49:27.243752 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.245320 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.247635 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.249255 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.249390 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.249587 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.250181 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.250552 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2106,"thread_start_us":1960,"threads_started":1}
I20260808 08:49:27.252146 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.238694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.8.149.67:33591)
0808 08:49:27.239573 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.239579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.240159 (+ 580us) server_negotiation.cc:407] Connection header received
0808 08:49:27.240448 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.240455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.240682 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.240958 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:49:27.244318 (+ 3360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.246143 (+ 1825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.248695 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.249946 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.250017 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.250254 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.251610 (+ 1356us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.251780 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":1808,"threads_started":1}
I20260808 08:49:27.252178 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.238588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33591 (local address 127.0.0.1:34364)
0808 08:49:27.240015 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.240033 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.240244 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.241330 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.241341 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.241395 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:49:27.244116 (+ 2721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.244131 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.246303 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.246309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.248542 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.248557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.251186 (+ 2629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.251196 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.251403 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.251437 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.251526 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.251666 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1275,"mutex_wait_us":2021,"spinlock_wait_cycles":5376,"thread_start_us":1124,"threads_started":1}
I20260808 08:49:27.254143 27703 tablet_service.cc:1467] Processing CreateTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 (DEFAULT_TABLE table=test-table [id=b48addcd54ef45b5891e0234ef4e6311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:49:27.254506 27476 tablet_service.cc:1467] Processing CreateTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 (DEFAULT_TABLE table=test-table [id=b48addcd54ef45b5891e0234ef4e6311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:49:27.255722 27703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ea1e880bbc47e0b2e6dde467af1f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:49:27.255851 27476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ea1e880bbc47e0b2e6dde467af1f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:49:27.255704 27928 tablet_service.cc:1467] Processing CreateTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 (DEFAULT_TABLE table=test-table [id=b48addcd54ef45b5891e0234ef4e6311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:49:27.256994 27928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ea1e880bbc47e0b2e6dde467af1f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:49:27.267505 28062 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Bootstrap starting.
I20260808 08:49:27.271442 28064 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Bootstrap starting.
I20260808 08:49:27.271922 28062 tablet_bootstrap.cc:654] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Neither blocks nor log segments found. Creating new log.
I20260808 08:49:27.272222 28063 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Bootstrap starting.
I20260808 08:49:27.273411 28062 log.cc:824] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Log is configured to *not* fsync() on all Append() calls
I20260808 08:49:27.275173 28064 tablet_bootstrap.cc:654] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Neither blocks nor log segments found. Creating new log.
I20260808 08:49:27.275501 28063 tablet_bootstrap.cc:654] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Neither blocks nor log segments found. Creating new log.
I20260808 08:49:27.276456 28064 log.cc:824] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:49:27.276554 28063 log.cc:824] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Log is configured to *not* fsync() on all Append() calls
I20260808 08:49:27.276747 28062 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: No bootstrap required, opened a new log
I20260808 08:49:27.277037 28062 ts_tablet_manager.cc:1397] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260808 08:49:27.279394 28064 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: No bootstrap required, opened a new log
I20260808 08:49:27.279655 28064 ts_tablet_manager.cc:1397] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 08:49:27.279702 28063 tablet_bootstrap.cc:492] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: No bootstrap required, opened a new log
I20260808 08:49:27.280030 28063 ts_tablet_manager.cc:1397] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 08:49:27.285151 28062 raft_consensus.cc:348] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.285540 28062 raft_consensus.cc:374] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:49:27.285677 28062 raft_consensus.cc:729] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49523797a7fc4a548f181828dcc3f568, State: Initialized, Role: FOLLOWER
I20260808 08:49:27.286309 28062 consensus_queue.cc:260] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.288286 28062 ts_tablet_manager.cc:1428] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Time spent starting tablet: real 0.011s user 0.005s sys 0.007s
I20260808 08:49:27.290357 28063 raft_consensus.cc:348] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.290357 28064 raft_consensus.cc:348] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.290753 28063 raft_consensus.cc:374] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:49:27.290753 28064 raft_consensus.cc:374] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:49:27.290854 28064 raft_consensus.cc:729] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5bc6f8b3e5b40039d8ddb6fd84ee77b, State: Initialized, Role: FOLLOWER
I20260808 08:49:27.290854 28063 raft_consensus.cc:729] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a87f24d55de4fde831499d927e68f36, State: Initialized, Role: FOLLOWER
I20260808 08:49:27.291615 28064 consensus_queue.cc:260] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.291895 28063 consensus_queue.cc:260] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.293151 28026 heartbeater.cc:503] Master 127.8.149.126:40733 was elected leader, sending a full tablet report...
I20260808 08:49:27.295085 27817 heartbeater.cc:503] Master 127.8.149.126:40733 was elected leader, sending a full tablet report...
I20260808 08:49:27.295360 28064 ts_tablet_manager.cc:1428] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260808 08:49:27.295751 28063 ts_tablet_manager.cc:1428] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
W20260808 08:49:27.405702 28028 tablet.cc:2369] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:49:27.447417 27574 tablet.cc:2369] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:49:27.458050 27819 tablet.cc:2369] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:49:27.463258 28079 raft_consensus.cc:482] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:49:27.463570 28079 raft_consensus.cc:504] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.465523 28079 leader_election.cc:288] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49523797a7fc4a548f181828dcc3f568 (127.8.149.65:35503), f5bc6f8b3e5b40039d8ddb6fd84ee77b (127.8.149.67:33591)
I20260808 08:49:27.473644 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.465995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:50531 (local address 127.8.149.65:35503)
0808 08:49:27.466309 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.466317 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.467305 (+ 988us) server_negotiation.cc:407] Connection header received
0808 08:49:27.467556 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.467560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.467617 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.467713 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:49:27.468691 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.469377 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.471748 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.472590 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.472776 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.472880 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.473227 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.473349 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:49:27.474337 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.465708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35503 (local address 127.8.149.66:50531)
0808 08:49:27.467202 (+ 1494us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.467216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.467387 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.467734 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.467738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.467761 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:49:27.468532 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.468542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.469508 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.469514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.471597 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.471610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.472876 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.472883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.473045 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.473070 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.473191 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.473308 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1367,"mutex_wait_us":23,"thread_start_us":1180,"threads_started":1}
I20260808 08:49:27.474850 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.466120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:51983 (local address 127.8.149.67:33591)
0808 08:49:27.466533 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.466541 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.466706 (+ 165us) server_negotiation.cc:407] Connection header received
0808 08:49:27.466973 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.466978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.467043 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.467149 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:49:27.468144 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.468985 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.471705 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.473253 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.473461 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.473570 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.474151 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.474280 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260808 08:49:27.474874 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.465688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33591 (local address 127.8.149.66:51983)
0808 08:49:27.466578 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0808 08:49:27.466595 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:49:27.466803 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:49:27.467168 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:49:27.467173 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:49:27.467206 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:49:27.467931 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.467942 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.469182 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.469187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.471547 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:49:27.471565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.473664 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.473671 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:49:27.473949 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.473991 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:49:27.474115 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:49:27.474246 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":68,"spinlock_wait_cycles":17792,"thread_start_us":434,"threads_started":1}
I20260808 08:49:27.475523 27500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ea1e880bbc47e0b2e6dde467af1f25" candidate_uuid: "3a87f24d55de4fde831499d927e68f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49523797a7fc4a548f181828dcc3f568" is_pre_election: true
I20260808 08:49:27.476384 27500 raft_consensus.cc:2454] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a87f24d55de4fde831499d927e68f36 in term 0.
I20260808 08:49:27.476428 27961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ea1e880bbc47e0b2e6dde467af1f25" candidate_uuid: "3a87f24d55de4fde831499d927e68f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" is_pre_election: true
I20260808 08:49:27.477140 27631 leader_election.cc:302] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a87f24d55de4fde831499d927e68f36, 49523797a7fc4a548f181828dcc3f568; no voters:
I20260808 08:49:27.477129 27961 raft_consensus.cc:2454] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a87f24d55de4fde831499d927e68f36 in term 0.
I20260808 08:49:27.477627 28079 raft_consensus.cc:2781] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:49:27.477921 28079 raft_consensus.cc:482] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:49:27.478124 28079 raft_consensus.cc:3037] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:49:27.481307 28079 raft_consensus.cc:504] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.482079 28079 leader_election.cc:288] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [CANDIDATE]: Term 1 election: Requested vote from peers 49523797a7fc4a548f181828dcc3f568 (127.8.149.65:35503), f5bc6f8b3e5b40039d8ddb6fd84ee77b (127.8.149.67:33591)
I20260808 08:49:27.482501 27961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ea1e880bbc47e0b2e6dde467af1f25" candidate_uuid: "3a87f24d55de4fde831499d927e68f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b"
I20260808 08:49:27.482580 27500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ea1e880bbc47e0b2e6dde467af1f25" candidate_uuid: "3a87f24d55de4fde831499d927e68f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49523797a7fc4a548f181828dcc3f568"
I20260808 08:49:27.482666 27961 raft_consensus.cc:3037] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:49:27.482875 27500 raft_consensus.cc:3037] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:49:27.484853 27961 raft_consensus.cc:2454] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a87f24d55de4fde831499d927e68f36 in term 1.
I20260808 08:49:27.485287 27625 leader_election.cc:302] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a87f24d55de4fde831499d927e68f36, f5bc6f8b3e5b40039d8ddb6fd84ee77b; no voters:
I20260808 08:49:27.485586 28079 raft_consensus.cc:2781] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:49:27.486205 28079 raft_consensus.cc:686] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 1 LEADER]: Becoming Leader. State: Replica: 3a87f24d55de4fde831499d927e68f36, State: Running, Role: LEADER
I20260808 08:49:27.486405 27500 raft_consensus.cc:2454] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a87f24d55de4fde831499d927e68f36 in term 1.
I20260808 08:49:27.486935 28079 consensus_queue.cc:237] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } }
I20260808 08:49:27.492292 27241 catalog_manager.cc:5495] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a87f24d55de4fde831499d927e68f36 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "3a87f24d55de4fde831499d927e68f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a87f24d55de4fde831499d927e68f36" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260808 08:49:27.546183 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.539872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38084 (local address 127.8.149.66:41167)
0808 08:49:27.540164 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.540180 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.540308 (+ 128us) server_negotiation.cc:407] Connection header received
0808 08:49:27.540511 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.540515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.540590 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.540721 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:49:27.541208 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.542187 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.543847 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.544343 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.544469 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.545146 (+ 677us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:49:27.545610 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:49:27.545715 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.545796 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.545853 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:49:27.555984 27961 raft_consensus.cc:1261] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 1 FOLLOWER]: Refusing update from remote peer 3a87f24d55de4fde831499d927e68f36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:49:27.555992 27500 raft_consensus.cc:1261] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 1 FOLLOWER]: Refusing update from remote peer 3a87f24d55de4fde831499d927e68f36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:49:27.556972 28085 consensus_queue.cc:1035] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49523797a7fc4a548f181828dcc3f568" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:49:27.557365 28079 consensus_queue.cc:1035] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5bc6f8b3e5b40039d8ddb6fd84ee77b" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:49:27.569526 28091 mvcc.cc:205] Tried to move back new op lower bound from 7316189051098763264 to 7316189050831859712. Current Snapshot: MvccSnapshot[applied={T|T < 7316189051098763264}]
I20260808 08:49:27.576491 28092 mvcc.cc:205] Tried to move back new op lower bound from 7316189051098763264 to 7316189050831859712. Current Snapshot: MvccSnapshot[applied={T|T < 7316189051098763264}]
I20260808 08:49:27.581918 27241 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:49:27.582223 27241 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:49:27.586313 27241 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e056a52d0b4640ad8a32afb064d5ab95: Sending DeleteTablet for 3 replicas of tablet 16ea1e880bbc47e0b2e6dde467af1f25
I20260808 08:49:27.587448 27928 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:49:27 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:34364
I20260808 08:49:27.587505 27476 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:49:27 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:46594
I20260808 08:49:27.587846 27703 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ea1e880bbc47e0b2e6dde467af1f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:49:27 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:38076
I20260808 08:49:27.589951 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 27366
I20260808 08:49:27.620546 28105 tablet_replica.cc:330] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: stopping tablet replica
I20260808 08:49:27.621105 28105 raft_consensus.cc:2229] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:49:27.622516 28105 raft_consensus.cc:2258] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:49:27.626770 28105 ts_tablet_manager.cc:1905] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:49:27.634498 28107 tablet_replica.cc:330] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: stopping tablet replica
I20260808 08:49:27.634775 28104 tablet_replica.cc:330] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: stopping tablet replica
I20260808 08:49:27.634984 28107 raft_consensus.cc:2229] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:49:27.635188 28104 raft_consensus.cc:2229] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:49:27.635671 28104 raft_consensus.cc:2258] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:49:27.635684 28107 raft_consensus.cc:2258] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:49:27.637689 28104 ts_tablet_manager.cc:1905] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:49:27.641605 28105 ts_tablet_manager.cc:1918] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:49:27.641769 28105 log.cc:1196] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/16ea1e880bbc47e0b2e6dde467af1f25
I20260808 08:49:27.642315 28105 ts_tablet_manager.cc:1939] T 16ea1e880bbc47e0b2e6dde467af1f25 P 49523797a7fc4a548f181828dcc3f568: Deleting consensus metadata
I20260808 08:49:27.644044 27217 catalog_manager.cc:4841] TS 49523797a7fc4a548f181828dcc3f568 (127.8.149.65:35503): tablet 16ea1e880bbc47e0b2e6dde467af1f25 (table test-table [id=b48addcd54ef45b5891e0234ef4e6311]) successfully deleted
I20260808 08:49:27.644550 28104 ts_tablet_manager.cc:1918] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:49:27.644693 28104 log.cc:1196] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/16ea1e880bbc47e0b2e6dde467af1f25
I20260808 08:49:27.645277 28104 ts_tablet_manager.cc:1939] T 16ea1e880bbc47e0b2e6dde467af1f25 P f5bc6f8b3e5b40039d8ddb6fd84ee77b: Deleting consensus metadata
I20260808 08:49:27.645889 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.591056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46596 (local address 127.8.149.65:35503)
0808 08:49:27.591215 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.591221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.615299 (+ 24078us) server_negotiation.cc:407] Connection header received
0808 08:49:27.615754 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.615759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.615839 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.615924 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:27.617768 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.618897 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.622968 (+ 4071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.623636 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.623738 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.637179 (+ 13441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:27.637193 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:27.637209 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:27.637270 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:27.641442 (+ 4172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.642375 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.642384 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.642387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.642550 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.643008 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.643013 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.643017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.643480 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:27.643772 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.644940 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.645474 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:49:27.646111 28107 ts_tablet_manager.cc:1905] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:49:27.646762 27564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:49:27.646975 27214 catalog_manager.cc:4841] TS f5bc6f8b3e5b40039d8ddb6fd84ee77b (127.8.149.67:33591): tablet 16ea1e880bbc47e0b2e6dde467af1f25 (table test-table [id=b48addcd54ef45b5891e0234ef4e6311]) successfully deleted
I20260808 08:49:27.651887 28107 ts_tablet_manager.cc:1918] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:49:27.652112 28107 log.cc:1196] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/16ea1e880bbc47e0b2e6dde467af1f25
I20260808 08:49:27.652700 28107 ts_tablet_manager.cc:1939] T 16ea1e880bbc47e0b2e6dde467af1f25 P 3a87f24d55de4fde831499d927e68f36: Deleting consensus metadata
I20260808 08:49:27.654557 27217 catalog_manager.cc:4841] TS 3a87f24d55de4fde831499d927e68f36 (127.8.149.66:41167): tablet 16ea1e880bbc47e0b2e6dde467af1f25 (table test-table [id=b48addcd54ef45b5891e0234ef4e6311]) successfully deleted
I20260808 08:49:27.754889 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 27366
I20260808 08:49:27.782325 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 27582
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:49:27.800022 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.783487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38086 (local address 127.8.149.66:41167)
0808 08:49:27.783669 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.783673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.783690 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:49:27.783746 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.783749 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.783842 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.783972 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:27.785344 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.786165 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.787594 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.788053 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.788245 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.793648 (+ 5403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:27.793658 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:27.793671 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:27.793721 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:27.797208 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.797984 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.797990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.797997 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.798133 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.798509 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.798512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.798514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.798809 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:27.799067 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.799424 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.799590 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:49:27.800727 27809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:49:27.908993 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 27582
I20260808 08:49:27.939689 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 27826
Aug 08 08:49:27 dist-test-slave-7vjv krb5kdc[26476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178963, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:49:27.955226 28056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:49:27.940589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34366 (local address 127.8.149.67:33591)
0808 08:49:27.940813 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:49:27.940819 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:49:27.940840 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:49:27.941043 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:49:27.941049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:49:27.941135 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:49:27.941247 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:49:27.942630 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.943288 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.944684 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:49:27.945049 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:49:27.945186 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:49:27.949820 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:49:27.949833 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:49:27.949850 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:49:27.949879 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:49:27.952716 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.953391 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.953398 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.953400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.953521 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:49:27.953884 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:49:27.953887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:49:27.953889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:49:27.954203 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:49:27.954408 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:49:27.954793 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 08:49:27.954967 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:49:27.955847 28020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:49:28.040915 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 27826
I20260808 08:49:28.064920 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 27184
I20260808 08:49:28.066099 27291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:49:28.176499 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 27184
I20260808 08:49:28.210917 8789 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:49:28.556210 8789 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:49:28.556486 8789 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:49:28.902681 8789 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:49:28.903 UTC [26519] LOG: received smart shutdown request
2026-08-08 08:49:28.906 UTC [26519] LOG: background worker "logical replication launcher" (PID 26532) exited with exit code 1
2026-08-08 08:49:28.907 UTC [26525] LOG: shutting down
2026-08-08 08:49:29.069 UTC [26519] LOG: database system is shut down
2026-08-08T08:49:29Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50278 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:49:29 dist-test-slave-7vjv krb5kdc[28133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:49:29 dist-test-slave-7vjv krb5kdc[28133](info): set up 2 sockets
Aug 08 08:49:29 dist-test-slave-7vjv krb5kdc[28133](info): commencing operation
krb5kdc: starting...
W20260808 08:49:30.488519 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:49:30 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:49:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:49:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangeradmin_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangeradmin_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangerlookup_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangerlookup_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
I20260808 08:49:30.824909 8789 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task4pJ3L_/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/postgres -l logfile start
2026-08-08 08:49:33.263 UTC [28180] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:49:33.263 UTC [28180] LOG: listening on IPv4 address "127.8.149.84", port 58873
2026-08-08 08:49:33.267 UTC [28180] LOG: listening on Unix socket "/tmp/.s.PGSQL.58873"
2026-08-08 08:49:33.288 UTC [28185] LOG: database system was shut down at 2026-08-08 08:49:31 UTC
2026-08-08 08:49:33.292 UTC [28180] LOG: database system is ready to accept connections
I20260808 08:49:34.429708 8789 mini_postgres.cc:96] Postgres bound to 58873
2026-08-08 08:49:34.453 UTC [28198] FATAL: database "slave" does not exist
127.8.149.84:58873 - accepting connections
I20260808 08:49:34.453985 8789 mini_ranger.cc:161] Starting Ranger...
I20260808 08:49:34.482101 8789 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:49:34.962255 8789 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:49:34.962409 8789 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin
2026-08-08 08:49:35,276 [I] DB FLAVOR :POSTGRES
2026-08-08 08:49:35,277 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:49:35,277 [I] Checking connection..
2026-08-08 08:49:35,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:49:35,531 [I] Checking connection passed.
2026-08-08 08:49:35,532 [I] --------- Verifying version history table ---------
2026-08-08 08:49:35,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:49:35,794 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:49:35,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:49:36,052 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:49:36,052 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:49:36,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:49:36.301 UTC [28306] WARNING: there is no transaction in progress
2026-08-08 08:49:36,311 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:49:36,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:49:36,588 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:49:36,588 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:49:36,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:49:36,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:49:37,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7vjv.c.gcp-upstream.internal','N') ;"
2026-08-08 08:49:37,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:49:37,563 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:49:37,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:49:37,814 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:49:37,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:49:38,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:49:38,283 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:49:38,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:49:39.219 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.236 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.252 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.267 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.281 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.296 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.346 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.352 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.366 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.376 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.386 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.400 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.409 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.415 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.422 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:39.428 UTC [28480] WARNING: there is no transaction in progress
2026-08-08 08:49:40,050 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:49:40,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:49:40,301 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:49:40,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:49:40,565 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:49:40,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:49:40,820 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:49:40,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:49:41,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:49:41,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7vjv.c.gcp-upstream.internal';"
2026-08-08 08:49:41,524 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:49:41,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:49:41,773 [I] DB_PATCHES have already been applied
I20260808 08:49:41.778999 8789 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task4pJ3L_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:49:41.779084 8789 mini_ranger.cc:193] Using host: 127.8.149.84
I20260808 08:49:41.798270 8789 mini_ranger.cc:227] Ranger admin URL: http://127.8.149.84:54717
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:49:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:49:43.164158 8789 mini_ranger.cc:160] Time spent starting Ranger: real 8.710s user 0.000s sys 0.051s
Aug 08, 2026 8:50:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:50:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 8:50:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:50:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:50:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:50:04.101495 8789 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.8.149.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.8.149.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangerkms_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.8.149.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/rangerkms_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.8.149.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.8.149.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.8.149.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/HTTP_127.8.149.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:50:04 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179004, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:50:04.311205 8789 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:50:04.339825 8789 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:50:05.162534 8789 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:50:05.162665 8789 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms
I20260808 08:50:05.162712 8789 mini_ranger_kms.cc:227] Using postgres at 127.8.149.84:58873
2026-08-08 08:50:05,509 [I] DB FLAVOR :POSTGRES
2026-08-08 08:50:05,509 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:50:05,510 [I] Checking connection
2026-08-08 08:50:05,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:50:05,728 [I] connection success
2026-08-08 08:50:05,728 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:50:05,728 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:50:05,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:50:05,962 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:50:05,962 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:50:05,962 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:50:05,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.8.149.84:58873/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:50:06,205 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:50:06.685197 8789 mini_ranger_kms.cc:310] Created kms service
I20260808 08:50:06.901547 8789 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:50:06.947063 8789 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:50:06 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179004, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:07.360849 8789 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:50:07.361228 8789 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms:/tmp/dist-test-task4pJ3L_/build/asan/bin/postgresql.jar:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task4pJ3L_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:50:07.361310 8789 mini_ranger_kms.cc:240] Using host: 127.8.149.84
I20260808 08:50:07.382100 8789 mini_ranger_kms.cc:276] Ranger KMS PID: 28785
I20260808 08:50:07.382229 8789 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.8.149.84:59031
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:50:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 08:50:08.752259 8789 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.441s user 0.096s sys 0.274s
I20260808 08:50:08.752563 8789 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:50:08.752737 8789 mini_ranger_kms.cc:401] 127.8.149.84:59031/kms/v1/keys
Aug 08 08:50:09 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786179009, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 08:50:09 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179009, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
Aug 08 08:50:10 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179009, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.8.149.84@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
Aug 08 08:50:12 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:50:12.339453 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41199
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41199
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:12.664709 28866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:12.664968 28866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:12.665053 28866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:12.671738 28866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:12.671841 28866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:12.671895 28866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:12.671953 28866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:12.672005 28866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:12.682175 28866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
--ranger_kms_url=127.8.149.84:59031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41199
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:12.683216 28866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:12.684543 28866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:12.696890 28872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:12.696825 28877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:12.696846 28873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:12.697619 28866 server_base.cc:1034] running on GCE node
I20260808 08:50:12.698442 28866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:12.699703 28866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:12.700910 28866 hybrid_clock.cc:648] HybridClock initialized: now 1786179012700810 us; error 60 us; skew 500 ppm
I20260808 08:50:12.701303 28866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:12 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:12.704458 28866 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:12.705729 28866 webserver.cc:460] Webserver started at http://127.8.149.126:33113/ using document root <none> and password file <none>
I20260808 08:50:12.706314 28866 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:12.706503 28866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:12.706754 28866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:50:12 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:12.763768 28866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "91fdc21f80d243038b54e9e02931ff13"
format_stamp: "Formatted at 2026-08-08 08:50:12 on dist-test-slave-7vjv"
server_key: "3b68e5582ba6ded7cc5281f2d6689eb2"
server_key_iv: "0fb1df87358b94721e94030bc0bc3ec4"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:12.764667 28866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "91fdc21f80d243038b54e9e02931ff13"
format_stamp: "Formatted at 2026-08-08 08:50:12 on dist-test-slave-7vjv"
server_key: "3b68e5582ba6ded7cc5281f2d6689eb2"
server_key_iv: "0fb1df87358b94721e94030bc0bc3ec4"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:12.769840 28866 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:50:12.788784 28887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:12.790328 28866 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:50:12.790570 28866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "91fdc21f80d243038b54e9e02931ff13"
format_stamp: "Formatted at 2026-08-08 08:50:12 on dist-test-slave-7vjv"
server_key: "3b68e5582ba6ded7cc5281f2d6689eb2"
server_key_iv: "0fb1df87358b94721e94030bc0bc3ec4"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:12.790812 28866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:12.810384 28866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:12.814108 28866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:12.814437 28866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:12.833477 28866 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:41199
I20260808 08:50:12.833498 28968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:41199 every 8 connection(s)
I20260808 08:50:12.834736 28866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:12.838122 28969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:12.843744 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 28866
I20260808 08:50:12.843966 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:50:12.844667 8789 external_mini_cluster.cc:1428] Setting key 1142cf72018cf4fde678abd8fc42b498
I20260808 08:50:12.848378 28969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Bootstrap starting.
I20260808 08:50:12.851832 28969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:12.852923 28969 log.cc:824] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:12.855695 28969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: No bootstrap required, opened a new log
Aug 08 08:50:12 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:12.863622 28969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:12.863958 28969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:12.864111 28969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fdc21f80d243038b54e9e02931ff13, State: Initialized, Role: FOLLOWER
I20260808 08:50:12.864706 28969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:12.864939 28969 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:12.865079 28969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:12.865275 28969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:12.866551 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:12.846539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48910 (local address 127.8.149.126:41199)
0808 08:50:12.847376 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:12.847388 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:12.847427 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:50:12.849199 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:12.849219 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:12.849609 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:12.849922 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:12.851617 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:12.853124 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:12.854708 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:12.855340 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:12.855467 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:12.859760 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:12.859767 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:12.859778 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:12.859814 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:12.862782 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:12.863430 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:12.863454 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:12.863459 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:12.863593 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:12.863979 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:12.863985 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:12.863988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:12.864586 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:12.864876 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:12.865304 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 08:50:12.865669 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":446,"threads_started":1}
I20260808 08:50:12.867429 28969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:12.867898 28969 leader_election.cc:302] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91fdc21f80d243038b54e9e02931ff13; no voters:
I20260808 08:50:12.868527 28969 leader_election.cc:288] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:50:12.868654 28978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:12.870014 28978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 LEADER]: Becoming Leader. State: Replica: 91fdc21f80d243038b54e9e02931ff13, State: Running, Role: LEADER
I20260808 08:50:12.870478 28969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:12.870481 28978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:12.873898 28984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91fdc21f80d243038b54e9e02931ff13. Latest consensus state: current_term: 1 leader_uuid: "91fdc21f80d243038b54e9e02931ff13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } } }
I20260808 08:50:12.874267 28984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:12.874003 28980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91fdc21f80d243038b54e9e02931ff13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } } }
I20260808 08:50:12.874409 28980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:12.876824 28995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:12.883365 28995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:12.884253 28969 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:50:12.914585 28995 catalog_manager.cc:1347] Generated new cluster ID: 0fc5f871ed044508882bb98ad5e20b84
I20260808 08:50:12.914750 28995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:12.973553 28995 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:50:12.975792 28995 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:12.987119 28995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Generated new TSK 0
I20260808 08:50:12.988350 28995 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:50:13.695266 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:50:13 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786179013, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:50:14.099762 29055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:14.100135 29055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:14.100287 29055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:14.111057 29055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:14.111178 29055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:14.111349 29055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:14.125898 29055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:14.127390 29055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:14.129055 29055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:14.149479 29079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:14.151109 29080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:14.165709 29082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:14.166224 29055 server_base.cc:1034] running on GCE node
I20260808 08:50:14.166915 29055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:14.168388 29055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:14.169608 29055 hybrid_clock.cc:648] HybridClock initialized: now 1786179014169544 us; error 59 us; skew 500 ppm
I20260808 08:50:14.169955 29055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:14 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179014, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:14.176199 29055 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:14.177917 29055 webserver.cc:460] Webserver started at http://127.8.149.65:39135/ using document root <none> and password file <none>
I20260808 08:50:14.178659 29055 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:14.178782 29055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:14.179100 29055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:50:14 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179014, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:14.198484 29055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "15c3df7cc53248ceb2d289be154e917f"
format_stamp: "Formatted at 2026-08-08 08:50:14 on dist-test-slave-7vjv"
server_key: "88b6d8b556ce1e7fd296993e582168a9"
server_key_iv: "16ec528d22e3779fe53aaa8a5e526e49"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:14.199483 29055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "15c3df7cc53248ceb2d289be154e917f"
format_stamp: "Formatted at 2026-08-08 08:50:14 on dist-test-slave-7vjv"
server_key: "88b6d8b556ce1e7fd296993e582168a9"
server_key_iv: "16ec528d22e3779fe53aaa8a5e526e49"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:14.222342 29055 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.021s sys 0.004s
I20260808 08:50:14.256649 29091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:14.258354 29055 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.003s sys 0.015s
I20260808 08:50:14.258704 29055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "15c3df7cc53248ceb2d289be154e917f"
format_stamp: "Formatted at 2026-08-08 08:50:14 on dist-test-slave-7vjv"
server_key: "88b6d8b556ce1e7fd296993e582168a9"
server_key_iv: "16ec528d22e3779fe53aaa8a5e526e49"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:14.258948 29055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:14.325999 29055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:14.331648 29055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:14.332052 29055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:14.333408 29055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:14.335430 29055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:14.335529 29055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:14.335650 29055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:14.335705 29055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:50:14 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179013, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
Aug 08 08:50:14 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179013, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:14.779600 29055 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:35855
I20260808 08:50:14.779729 29290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:35855 every 8 connection(s)
I20260808 08:50:14.781626 29055 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:14.790562 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 29055
I20260808 08:50:14.790745 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:50:14.791424 8789 external_mini_cluster.cc:1428] Setting key a29cf29f7ce43455f8bcb314720b4283
Aug 08 08:50:14 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179014, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:14.838464 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:14.788550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:38133 (local address 127.8.149.126:41199)
0808 08:50:14.808592 (+ 20042us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:14.808598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:14.808620 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:50:14.808691 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:14.808696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:14.808795 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:14.808938 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:14.811533 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:14.812973 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:14.815433 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:14.816079 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:14.816280 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:14.828280 (+ 12000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:14.828287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:14.828293 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:14.828350 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:14.833523 (+ 5173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:14.835521 (+ 1998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:14.835527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:14.835531 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:14.835678 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:14.836239 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:14.836244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:14.836248 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:14.836606 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:14.836722 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:14.837725 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0808 08:50:14.837941 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19897,"thread_start_us":18442,"threads_started":1}
I20260808 08:50:14.841104 29297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:14.789904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.65:38133)
0808 08:50:14.803957 (+ 14053us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:14.804013 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:14.806879 (+ 2866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:14.809270 (+ 2391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:14.809283 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:14.809995 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:14.811300 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:14.811325 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:14.813174 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:14.813181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:14.815229 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:14.815246 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:14.816619 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:14.816628 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:14.816926 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:14.820006 (+ 3080us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:14.820056 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:14.827920 (+ 7864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:14.834732 (+ 6812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:14.834743 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:14.834763 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:14.835367 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:14.835831 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:14.835836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:14.835840 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:14.836085 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:14.836816 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:14.836825 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:14.837247 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:50:14.838800 (+ 1553us) client_negotiation.cc:240] Negotiation successful
0808 08:50:14.839319 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13683,"thread_start_us":17227,"threads_started":1}
I20260808 08:50:14.843699 29292 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:14.844019 29292 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:14.845045 29292 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:14.848759 28918 ts_manager.cc:194] Registered new tserver with Master: 15c3df7cc53248ceb2d289be154e917f (127.8.149.65:35855)
I20260808 08:50:14.850929 28918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:38133
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
W20260808 08:50:14.931317 8789 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.8.149.66: real 0.122s user 0.001s sys 0.022s
I20260808 08:50:14.932483 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:15.379976 29304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:15.380327 29304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:15.380507 29304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:15.390858 29304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:15.390993 29304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:15.391218 29304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:15.404831 29304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:15.406430 29304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:15.408110 29304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:15.424729 29324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:15.431104 29325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:15.431980 29327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:15.432844 29304 server_base.cc:1034] running on GCE node
I20260808 08:50:15.433513 29304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:15.434597 29304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:15.435910 29304 hybrid_clock.cc:648] HybridClock initialized: now 1786179015435843 us; error 50 us; skew 500 ppm
I20260808 08:50:15.436281 29304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:15 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:15.440307 29304 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:15.442224 29304 webserver.cc:460] Webserver started at http://127.8.149.66:46145/ using document root <none> and password file <none>
I20260808 08:50:15.443084 29304 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:15.443221 29304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:15.443625 29304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:50:15 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:15.470333 29304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "388041004e00420f9a4ae0c3c21a17a5"
format_stamp: "Formatted at 2026-08-08 08:50:15 on dist-test-slave-7vjv"
server_key: "06e7030070db26942d8d92ebbdb658ba"
server_key_iv: "f23e0ce4196da813d1f5607f8c12c33f"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:15.471546 29304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "388041004e00420f9a4ae0c3c21a17a5"
format_stamp: "Formatted at 2026-08-08 08:50:15 on dist-test-slave-7vjv"
server_key: "06e7030070db26942d8d92ebbdb658ba"
server_key_iv: "f23e0ce4196da813d1f5607f8c12c33f"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:15.492690 29304 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.008s sys 0.011s
I20260808 08:50:15.520756 29342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:15.524967 29304 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.007s sys 0.000s
I20260808 08:50:15.525228 29304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "388041004e00420f9a4ae0c3c21a17a5"
format_stamp: "Formatted at 2026-08-08 08:50:15 on dist-test-slave-7vjv"
server_key: "06e7030070db26942d8d92ebbdb658ba"
server_key_iv: "f23e0ce4196da813d1f5607f8c12c33f"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:15.525549 29304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:15.583943 29304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:15.589354 29304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:15.589778 29304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:15.605487 29304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:15.607152 29304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:15.607235 29304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:15.607342 29304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:15.607400 29304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:15.652906 29304 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40905
I20260808 08:50:15.653049 29519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40905 every 8 connection(s)
I20260808 08:50:15.654426 29304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:15.658635 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 29304
I20260808 08:50:15.658797 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:50:15.659382 8789 external_mini_cluster.cc:1428] Setting key 2ccd292a5af10cbe07a7b8c1979c7290
Aug 08 08:50:15 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179015, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:15.691491 29525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:15.657922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.66:33313)
0808 08:50:15.664649 (+ 6727us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:15.664712 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:15.671555 (+ 6843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:15.672590 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:15.672601 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:15.673181 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:15.673991 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:15.674030 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:15.675389 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:15.675393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:15.677326 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:15.677340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:15.678480 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:15.678489 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:15.678783 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:15.679592 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:15.679640 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:15.682449 (+ 2809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:15.686654 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:15.686663 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:15.686678 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:15.687229 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:15.687702 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:15.687707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:15.687711 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:15.687988 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:15.688783 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:15.688791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:15.689221 (+ 430us) client_negotiation.cc:769] Sending connection context
0808 08:50:15.689552 (+ 331us) client_negotiation.cc:240] Negotiation successful
0808 08:50:15.690092 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6470,"thread_start_us":6236,"threads_started":1}
I20260808 08:50:15.693459 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:15.660253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:33313 (local address 127.8.149.126:41199)
0808 08:50:15.662465 (+ 2212us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:15.662471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:15.665007 (+ 2536us) server_negotiation.cc:407] Connection header received
0808 08:50:15.671865 (+ 6858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:15.671871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:15.671969 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:15.672051 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:15.674213 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:15.675195 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:15.677510 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:15.678199 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:15.679205 (+ 1006us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:15.682706 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:15.682713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:15.682717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:15.682758 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:15.686481 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:15.687412 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:15.687417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:15.687421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:15.687566 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:15.688189 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:15.688194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:15.688197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:15.688606 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:15.692636 (+ 4030us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:15.692767 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 08:50:15.693007 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2074,"thread_start_us":1950,"threads_started":1}
I20260808 08:50:15.695195 29520 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:15.695541 29520 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:15.696467 29520 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
I20260808 08:50:15.698273 28918 ts_manager.cc:194] Registered new tserver with Master: 388041004e00420f9a4ae0c3c21a17a5 (127.8.149.66:40905)
I20260808 08:50:15.699373 28918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:33313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:50:15.737759 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:15.854871 29292 heartbeater.cc:503] Master 127.8.149.126:41199 was elected leader, sending a full tablet report...
W20260808 08:50:16.121280 29531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:16.121680 29531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:16.121876 29531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:16.131170 29531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:16.131414 29531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:16.131665 29531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:16.143788 29531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:16.145242 29531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:16.146713 29531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:16.164371 29538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:16.165292 29547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:16.165313 29539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:16.166057 29531 server_base.cc:1034] running on GCE node
I20260808 08:50:16.166710 29531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:16.168062 29531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:16.169375 29531 hybrid_clock.cc:648] HybridClock initialized: now 1786179016169290 us; error 52 us; skew 500 ppm
I20260808 08:50:16.169771 29531 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179016, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:16.174167 29531 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:16.176177 29531 webserver.cc:460] Webserver started at http://127.8.149.67:34445/ using document root <none> and password file <none>
I20260808 08:50:16.176998 29531 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:16.177207 29531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:16.177560 29531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179016, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:16.194757 29531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "78549bba95b94508b535c6e0ae465156"
format_stamp: "Formatted at 2026-08-08 08:50:16 on dist-test-slave-7vjv"
server_key: "ffb6b235d235c7c4548852b25ab2fb4f"
server_key_iv: "428eeaa164b05e46a36ddd5d68b409da"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:16.195959 29531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "78549bba95b94508b535c6e0ae465156"
format_stamp: "Formatted at 2026-08-08 08:50:16 on dist-test-slave-7vjv"
server_key: "ffb6b235d235c7c4548852b25ab2fb4f"
server_key_iv: "428eeaa164b05e46a36ddd5d68b409da"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:16.203596 29531 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260808 08:50:16.219671 29557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:16.221328 29531 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:50:16.221599 29531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "78549bba95b94508b535c6e0ae465156"
format_stamp: "Formatted at 2026-08-08 08:50:16 on dist-test-slave-7vjv"
server_key: "ffb6b235d235c7c4548852b25ab2fb4f"
server_key_iv: "428eeaa164b05e46a36ddd5d68b409da"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:16.221897 29531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:16.239199 29531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:16.244237 29531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:16.244527 29531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:16.245846 29531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:16.247704 29531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:16.247845 29531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:16.248080 29531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:16.248257 29531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 08:50:16.296904 29531 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:33529
I20260808 08:50:16.296921 29741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:33529 every 8 connection(s)
I20260808 08:50:16.298086 29531 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:16.301012 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 29531
I20260808 08:50:16.301204 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:50:16.301708 8789 external_mini_cluster.cc:1428] Setting key d59c981ff81fedee7ea278987098d165
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179016, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:16.319243 29746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:16.300930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:39983 (local address 127.8.149.126:41199)
0808 08:50:16.303930 (+ 3000us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:16.303937 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:16.303959 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:50:16.305374 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:16.305378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:16.305467 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:16.305556 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:16.306958 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.307693 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.309137 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.309545 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.309632 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:16.312884 (+ 3252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:16.312889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:16.312915 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:16.312944 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:16.315624 (+ 2680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.316557 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.316562 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.316567 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.316716 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.317389 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.317393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.317396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.317762 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:16.317912 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:16.318718 (+ 806us) server_negotiation.cc:299] Negotiation successful
0808 08:50:16.318925 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2858,"thread_start_us":2650,"threads_started":1}
I20260808 08:50:16.320082 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:16.301700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.67:39983)
0808 08:50:16.302840 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:16.302888 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:16.305139 (+ 2251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:16.305768 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:16.305775 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:16.306188 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:16.306796 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:16.306813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.307824 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.307827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:16.309020 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:16.309032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.309745 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.309749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:16.309964 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:16.310531 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:16.310550 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:16.312689 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:16.315777 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:16.315783 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:16.315792 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:16.316440 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:16.316851 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:16.316855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:16.316858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:16.317117 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:16.317924 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:16.317931 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:16.318284 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 08:50:16.318583 (+ 299us) client_negotiation.cc:240] Negotiation successful
0808 08:50:16.319016 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"thread_start_us":513,"threads_started":1}
I20260808 08:50:16.321429 29742 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:16.321692 29742 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:16.322335 29742 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:16.323715 28918 ts_manager.cc:194] Registered new tserver with Master: 78549bba95b94508b535c6e0ae465156 (127.8.149.67:33529)
I20260808 08:50:16.324579 28918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:39983
I20260808 08:50:16.329406 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:50:16.331248 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 29055
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:50:16.352851 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:16.332269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41418 (local address 127.8.149.65:35855)
0808 08:50:16.333152 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:16.333158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:16.333181 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:50:16.333232 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:16.333237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:16.333437 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:16.333559 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:16.334997 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.336521 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.338444 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.339094 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.339229 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:16.346170 (+ 6941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:16.346181 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:16.346193 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:16.346223 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:16.349514 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.350409 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.350417 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.350421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.350649 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.351090 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.351094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.351098 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.351470 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:16.351867 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:16.352154 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 08:50:16.352446 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":533,"threads_started":1}
I20260808 08:50:16.354084 29282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:16.436671 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 29055
I20260808 08:50:16.461874 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 29304
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:50:16.484498 29760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:16.462835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.8.149.66:40905)
0808 08:50:16.463506 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:16.463512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:16.463536 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:50:16.463625 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:16.463631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:16.463819 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:16.464028 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:16.465851 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.467059 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.468935 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.469521 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.469671 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:16.478437 (+ 8766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:16.478447 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:16.478460 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:16.478493 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:16.481400 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.482113 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.482120 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.482122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.482257 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.482654 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.482658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.482660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.483000 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:16.483311 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:16.483656 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:50:16.483990 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":403,"threads_started":1}
I20260808 08:50:16.485916 29513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:16.566736 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 29304
I20260808 08:50:16.593418 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 29531
Aug 08 08:50:16 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:50:16.609480 29762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:16.594549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33544 (local address 127.8.149.67:33529)
0808 08:50:16.595362 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:16.595368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:16.595396 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:50:16.595453 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:16.595459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:16.595671 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:16.595786 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:16.597094 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.598062 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.599222 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:16.599847 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:16.599941 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:16.604209 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:16.604219 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:16.604230 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:16.604262 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:16.607111 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.607662 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.607668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.607670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.607783 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:16.608079 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:16.608082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:16.608084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:16.608434 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:16.608678 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:16.608903 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 08:50:16.609098 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":448,"threads_started":1}
I20260808 08:50:16.610749 29733 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:16.691612 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 29531
I20260808 08:50:16.712886 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 28866
I20260808 08:50:16.714067 28963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:16.814581 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 28866
I20260808 08:50:16.845525 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41199
--webserver_interface=127.8.149.126
--webserver_port=33113
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41199
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:17.160573 29766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:17.160851 29766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:17.161007 29766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:17.167711 29766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:17.167800 29766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:17.167928 29766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:17.168026 29766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:17.168123 29766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:17.177913 29766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41199
--ranger_config_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=33113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:17.179086 29766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:17.180495 29766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:17.192811 29777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:17.192945 29778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:17.192839 29782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:17.193691 29766 server_base.cc:1034] running on GCE node
I20260808 08:50:17.194449 29766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:17.195780 29766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:17.197082 29766 hybrid_clock.cc:648] HybridClock initialized: now 1786179017197026 us; error 58 us; skew 500 ppm
I20260808 08:50:17.197463 29766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:17 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:17.200842 29766 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:17.202368 29766 webserver.cc:460] Webserver started at http://127.8.149.126:33113/ using document root <none> and password file <none>
I20260808 08:50:17.203020 29766 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:17.203202 29766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:50:17 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:17.247382 29766 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:50:17.250319 29797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:17.251713 29766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:50:17.251902 29766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "91fdc21f80d243038b54e9e02931ff13"
format_stamp: "Formatted at 2026-08-08 08:50:12 on dist-test-slave-7vjv"
server_key: "3b68e5582ba6ded7cc5281f2d6689eb2"
server_key_iv: "0fb1df87358b94721e94030bc0bc3ec4"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:17.252871 29766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:17.271883 29766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:17.275815 29766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:17.276171 29766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:17.294099 29766 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:41199
I20260808 08:50:17.294131 29875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:41199 every 8 connection(s)
I20260808 08:50:17.295449 29766 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:17.300535 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 29766
I20260808 08:50:17.301584 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:35855
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:41199
--webserver_port=39135
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:17.302321 29876 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:50:17.307225 29876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Bootstrap starting.
I20260808 08:50:17.328408 29876 log.cc:824] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:17.337020 29876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:50:17.337568 29876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Bootstrap complete.
I20260808 08:50:17.346279 29876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:17.347103 29876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fdc21f80d243038b54e9e02931ff13, State: Initialized, Role: FOLLOWER
I20260808 08:50:17.347700 29876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:17.347927 29876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:17.348112 29876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:17.348323 29876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:50:17.351963 29876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:17.352483 29876 leader_election.cc:302] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91fdc21f80d243038b54e9e02931ff13; no voters:
I20260808 08:50:17.353103 29876 leader_election.cc:288] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:50:17.353315 29882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:50:17.354461 29882 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [term 2 LEADER]: Becoming Leader. State: Replica: 91fdc21f80d243038b54e9e02931ff13, State: Running, Role: LEADER
I20260808 08:50:17.355046 29876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:17.355075 29882 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } }
I20260808 08:50:17.361883 29883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "91fdc21f80d243038b54e9e02931ff13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } } }
I20260808 08:50:17.362305 29883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:17.362993 29884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91fdc21f80d243038b54e9e02931ff13. Latest consensus state: current_term: 2 leader_uuid: "91fdc21f80d243038b54e9e02931ff13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91fdc21f80d243038b54e9e02931ff13" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41199 } } }
I20260808 08:50:17.363286 29884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:17.383751 29901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:17.389762 29901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:17.391206 29901 catalog_manager.cc:1259] Loaded cluster ID: 0fc5f871ed044508882bb98ad5e20b84
I20260808 08:50:17.391618 29901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:17.395460 29901 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:17.396852 29901 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Loaded TSK: 0
I20260808 08:50:17.398236 29901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:50:17.400484 29876 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260808 08:50:17.746227 29880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:17.746697 29880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:17.746903 29880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:17.757761 29880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:17.757951 29880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:17.758198 29880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:17.773243 29880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:35855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=39135
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:17.774899 29880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:17.776648 29880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:17.806209 29943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:17.808501 29944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:17.815001 29947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:17.815538 29880 server_base.cc:1034] running on GCE node
I20260808 08:50:17.816397 29880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:17.817621 29880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:17.818917 29880 hybrid_clock.cc:648] HybridClock initialized: now 1786179017818848 us; error 46 us; skew 500 ppm
I20260808 08:50:17.819274 29880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:17 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:17.825945 29880 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:17.836508 29880 webserver.cc:460] Webserver started at http://127.8.149.65:39135/ using document root <none> and password file <none>
I20260808 08:50:17.837473 29880 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:17.837666 29880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:50:17 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:17.901700 29880 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.004s sys 0.000s
I20260808 08:50:17.912803 29960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:17.917541 29880 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.003s sys 0.001s
I20260808 08:50:17.917733 29880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "15c3df7cc53248ceb2d289be154e917f"
format_stamp: "Formatted at 2026-08-08 08:50:14 on dist-test-slave-7vjv"
server_key: "88b6d8b556ce1e7fd296993e582168a9"
server_key_iv: "16ec528d22e3779fe53aaa8a5e526e49"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:17.919135 29880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:17.937742 29880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:17.942776 29880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:17.943135 29880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:17.955092 29880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:17.963040 29880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:17.963196 29880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:50:17.963373 29880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:17.963513 29880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:18.027894 29880 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:35855
I20260808 08:50:18.027974 30146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:35855 every 8 connection(s)
I20260808 08:50:18.030117 29880 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:18.035888 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 29880
I20260808 08:50:18.036754 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:40905
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:41199
--webserver_port=46145
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:50:18 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179017, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:18.070016 30151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:18.033424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.65:42403)
0808 08:50:18.045791 (+ 12367us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:18.045856 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:18.048958 (+ 3102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:18.051685 (+ 2727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:18.051691 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:18.052154 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:18.052786 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:18.052810 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.055208 (+ 2398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.055212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:18.056975 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:18.056990 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.058468 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.058473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:18.058630 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:18.059318 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:18.059372 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:18.062123 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:18.065743 (+ 3620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:18.065753 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:18.065766 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:18.066169 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:18.066652 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:18.066659 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:18.066664 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:18.066842 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:18.067577 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:18.067585 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:18.067905 (+ 320us) client_negotiation.cc:769] Sending connection context
0808 08:50:18.068194 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 08:50:18.068731 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11991,"thread_start_us":15920,"threads_started":1}
I20260808 08:50:18.070016 30150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:18.033357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:42403 (local address 127.8.149.126:41199)
0808 08:50:18.050032 (+ 16675us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:18.050052 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:18.050110 (+ 58us) server_negotiation.cc:407] Connection header received
0808 08:50:18.050590 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:18.050610 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:18.051115 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:18.051580 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:18.053028 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.055005 (+ 1977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.057144 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.057952 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.058117 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:18.062404 (+ 4287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:18.062411 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:18.062422 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:18.062456 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:18.065611 (+ 3155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:18.066349 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:18.066375 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:18.066381 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:18.066532 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:18.066969 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:18.066973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:18.066978 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:18.067426 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:18.067651 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:18.068405 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 08:50:18.068750 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16408,"thread_start_us":16162,"threads_started":1}
I20260808 08:50:18.073473 30148 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:18.073813 30148 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:18.074548 30148 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
W20260808 08:50:18.077486 30148 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:41199 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:50:18.077713 30148 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:18.077927 30148 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:18.078949 30148 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:18.079195 30148 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
W20260808 08:50:18.080328 30148 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:50:18.466419 30152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:18.466776 30152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:18.467005 30152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:18.478018 30152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:18.478199 30152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:18.478431 30152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:18.492362 30152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:40905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=46145
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:18.493945 30152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:18.495612 30152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:18.513042 30172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:18.513046 30174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:18.524524 30152 server_base.cc:1034] running on GCE node
W20260808 08:50:18.525527 30176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:18.526448 30152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:18.539144 30152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:18.540446 30152 hybrid_clock.cc:648] HybridClock initialized: now 1786179018540326 us; error 111 us; skew 500 ppm
I20260808 08:50:18.540879 30152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:18 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:18.545579 30152 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:18.551059 30152 webserver.cc:460] Webserver started at http://127.8.149.66:46145/ using document root <none> and password file <none>
I20260808 08:50:18.552060 30152 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:18.552239 30152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:50:18 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:18.603592 30152 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.001s sys 0.009s
I20260808 08:50:18.619693 30191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:18.621610 30152 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.004s sys 0.011s
I20260808 08:50:18.621794 30152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "388041004e00420f9a4ae0c3c21a17a5"
format_stamp: "Formatted at 2026-08-08 08:50:15 on dist-test-slave-7vjv"
server_key: "06e7030070db26942d8d92ebbdb658ba"
server_key_iv: "f23e0ce4196da813d1f5607f8c12c33f"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:18.623073 30152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 08:50:18 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:18.641031 30152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:18.645831 30152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:18.646201 30152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:18.662730 30152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:18.672260 30152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:18.672462 30152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:18.672672 30152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:18.672823 30152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:18.750901 30152 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40905
I20260808 08:50:18.750963 30369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40905 every 8 connection(s)
I20260808 08:50:18.753043 30152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:18.761444 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 30152
I20260808 08:50:18.762236 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.8.149.84:59031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:33529
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:41199
--webserver_port=34445
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:50:18 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:18.791821 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:18.758773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:49121 (local address 127.8.149.126:41199)
0808 08:50:18.764264 (+ 5491us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:18.764270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:18.764293 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:50:18.764364 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:18.764370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:18.764453 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:18.764564 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:18.768367 (+ 3803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.769630 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.772139 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.772825 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.772983 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:18.777406 (+ 4423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:18.777414 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:18.777419 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:18.777462 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:18.785847 (+ 8385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:18.786927 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:18.786934 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:18.786938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:18.787108 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:18.787698 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:18.787704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:18.787708 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:18.788118 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:18.788276 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:18.790158 (+ 1882us) server_negotiation.cc:299] Negotiation successful
0808 08:50:18.790388 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5352,"thread_start_us":9574,"threads_started":1}
I20260808 08:50:18.792758 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:18.758113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.66:49121)
0808 08:50:18.760574 (+ 2461us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:18.760636 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:18.763121 (+ 2485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:18.766632 (+ 3511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:18.766644 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:18.767314 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:18.768086 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:18.768138 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.769922 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.769928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:18.771956 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:18.771969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:18.773092 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:18.773101 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:18.773402 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:18.774486 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:18.774516 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:18.777145 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:18.786058 (+ 8913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:18.786069 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:18.786086 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:18.786729 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:18.787286 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:18.787292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:18.787296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:18.787542 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:18.788372 (+ 830us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:18.788380 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:18.788786 (+ 406us) client_negotiation.cc:769] Sending connection context
0808 08:50:18.789133 (+ 347us) client_negotiation.cc:240] Negotiation successful
0808 08:50:18.791312 (+ 2179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2148,"thread_start_us":1884,"threads_started":1}
I20260808 08:50:18.794481 30370 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:18.794796 30370 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:18.795656 30370 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:18.797700 29819 ts_manager.cc:194] Registered new tserver with Master: 388041004e00420f9a4ae0c3c21a17a5 (127.8.149.66:40905)
I20260808 08:50:18.799809 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:49121
I20260808 08:50:19.080523 30148 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:19.081270 30148 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:19.082558 29819 ts_manager.cc:194] Registered new tserver with Master: 15c3df7cc53248ceb2d289be154e917f (127.8.149.65:35855)
I20260808 08:50:19.083760 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:42403
Aug 08 08:50:19 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
W20260808 08:50:19.226256 30376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:19.226595 30376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:19.226781 30376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:19.236609 30376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:19.236725 30376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:19.236915 30376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:19.250381 30376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.8.149.84:59031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:33529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=34445
--tserver_master_addrs=127.8.149.126:41199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:19.251863 30376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:19.253464 30376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:19.269148 30384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:19.269711 30386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:19.277575 30376 server_base.cc:1034] running on GCE node
W20260808 08:50:19.278026 30390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:19.278805 30376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:19.280015 30376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:19.281351 30376 hybrid_clock.cc:648] HybridClock initialized: now 1786179019281293 us; error 43 us; skew 500 ppm
I20260808 08:50:19.281713 30376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:19 dist-test-slave-7vjv krb5kdc[28133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179019, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:19.288359 30376 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:19.290230 30376 webserver.cc:460] Webserver started at http://127.8.149.67:34445/ using document root <none> and password file <none>
I20260808 08:50:19.291134 30376 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:19.291290 30376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:50:19 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179019, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:19.323733 30376 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:50:19.328318 30404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:19.330199 30376 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.003s
I20260808 08:50:19.330363 30376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "78549bba95b94508b535c6e0ae465156"
format_stamp: "Formatted at 2026-08-08 08:50:16 on dist-test-slave-7vjv"
server_key: "ffb6b235d235c7c4548852b25ab2fb4f"
server_key_iv: "428eeaa164b05e46a36ddd5d68b409da"
server_key_version: "kuduclusterkey@0"
I20260808 08:50:19.331875 30376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:19.364341 30376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:19.369453 30376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:19.369779 30376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:19.373903 30376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:19.375588 30376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:19.375711 30376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:19.375808 30376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:19.375914 30376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:50:19 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179018, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for HTTP/127.8.149.84@KRBTEST.COM
I20260808 08:50:19.569048 30376 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:33529
I20260808 08:50:19.569092 30588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:33529 every 8 connection(s)
I20260808 08:50:19.571074 30376 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:19.575279 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 30376
I20260808 08:50:19.603782 30591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.577019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54226 (local address 127.8.149.126:41199)
0808 08:50:19.582124 (+ 5105us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.582130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.582151 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:50:19.582244 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.582249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.582340 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.582452 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:19.588250 (+ 5798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.589737 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.592857 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.593560 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.593705 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.597271 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:19.597276 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:19.597279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:19.597320 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:19.600934 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.601713 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.601719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.601721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.601855 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.602265 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.602275 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.602277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.602520 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:19.602812 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.603123 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.603357 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4965,"thread_start_us":9925,"threads_started":1}
Aug 08 08:50:19 dist-test-slave-7vjv krb5kdc[28133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179019, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:19.617012 30595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.587081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:37169 (local address 127.8.149.126:41199)
0808 08:50:19.587687 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.587695 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.590630 (+ 2935us) server_negotiation.cc:407] Connection header received
0808 08:50:19.594727 (+ 4097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.594735 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.594824 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.594905 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:19.598143 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.598907 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.606760 (+ 7853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.607191 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.607326 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.610913 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:19.610918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:19.610921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:19.610953 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:19.613609 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.614334 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.614344 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.614346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.614458 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.614990 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.614996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.615000 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.615341 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:19.615472 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.616445 (+ 973us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.616653 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":304,"threads_started":1}
I20260808 08:50:19.619172 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.586407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41199 (local address 127.8.149.67:37169)
0808 08:50:19.590470 (+ 4063us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.590521 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.594388 (+ 3867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.595523 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.595535 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.596203 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:19.597113 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.597906 (+ 793us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.599762 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.599769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.606621 (+ 6852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.606633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.607414 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.607424 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.607653 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.608644 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:19.608666 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:19.610646 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:19.613760 (+ 3114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:19.613768 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:19.613782 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:19.614205 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:19.614612 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:19.614616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:19.614620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:19.614852 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:19.615569 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:19.615576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:19.615975 (+ 399us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.617277 (+ 1302us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.617811 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3791,"thread_start_us":3563,"threads_started":1}
I20260808 08:50:19.620939 30589 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41199
I20260808 08:50:19.621295 30589 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:19.622184 30589 heartbeater.cc:511] Master 127.8.149.126:41199 requested a full tablet report, sending...
I20260808 08:50:19.623714 29819 ts_manager.cc:194] Registered new tserver with Master: 78549bba95b94508b535c6e0ae465156 (127.8.149.67:33529)
I20260808 08:50:19.624814 29819 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:37169
I20260808 08:50:19.634876 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:50:19.653636 30595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.638563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54240 (local address 127.8.149.126:41199)
0808 08:50:19.638735 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.638741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.639246 (+ 505us) server_negotiation.cc:407] Connection header received
0808 08:50:19.639426 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.639432 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.639507 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.639617 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:19.641662 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.642782 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.644710 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.645103 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.645232 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.648493 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:19.648498 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:19.648501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:19.648529 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:19.651140 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.651886 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.651889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.651891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.651994 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.652390 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.652393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.652395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.652677 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:19.652849 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.653243 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.653397 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:50:19.659241 29819 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:50:19.670593 29819 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:50:19.721469 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.685972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35855 (local address 127.0.0.1:42796)
0808 08:50:19.697664 (+ 11692us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.697703 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.697867 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.712135 (+ 14268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.712146 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.712185 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:19.712647 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.712679 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.716214 (+ 3535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.716219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.718496 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.718514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.720536 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.720543 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.720753 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.720824 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.720925 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.721110 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11429,"thread_start_us":11274,"threads_started":1}
I20260808 08:50:19.722594 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.686726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42796 (local address 127.8.149.65:35855)
0808 08:50:19.711088 (+ 24362us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.711100 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.711136 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:50:19.711253 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.711264 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.711609 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.712930 (+ 1321us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:19.713215 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.714852 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.718743 (+ 3891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.720238 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.721756 (+ 1518us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.722039 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.722124 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.722285 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24118,"thread_start_us":25056,"threads_started":1}
I20260808 08:50:19.726148 30626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.686175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40905 (local address 127.0.0.1:34396)
0808 08:50:19.715362 (+ 29187us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.715388 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.715501 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.716886 (+ 1385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.716892 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.716921 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:19.717407 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.717419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.719112 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.719117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.721267 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.721281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.724843 (+ 3562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.724849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.725328 (+ 479us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.725366 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.725513 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.725652 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29044,"mutex_wait_us":282,"thread_start_us":29739,"threads_started":1}
I20260808 08:50:19.726933 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.686476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.8.149.66:40905)
0808 08:50:19.716035 (+ 29559us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.716045 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.716072 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:50:19.716187 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.716198 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.716430 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.716631 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:19.717620 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.718965 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.721446 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.724503 (+ 3057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.724964 (+ 461us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.725150 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.726438 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.726613 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29377,"thread_start_us":29224,"threads_started":1}
I20260808 08:50:19.728045 30632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.705520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33529 (local address 127.0.0.1:45310)
0808 08:50:19.717908 (+ 12388us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.717925 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.718033 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.720174 (+ 2141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.720178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.720203 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:19.720588 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.720599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.723085 (+ 2486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.723090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.725134 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.725149 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.727132 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.727138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.727298 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.727328 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.727404 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.727515 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12258,"mutex_wait_us":1,"thread_start_us":12591,"threads_started":1}
I20260808 08:50:19.728858 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.698625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.8.149.67:33529)
0808 08:50:19.717479 (+ 18854us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.717488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.718415 (+ 927us) server_negotiation.cc:407] Connection header received
0808 08:50:19.718515 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.718522 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.718687 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.719931 (+ 1244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:19.720920 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.722935 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.725331 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.726720 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.726833 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.728287 (+ 1454us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.728375 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.728519 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18676,"thread_start_us":19580,"threads_started":1}
I20260808 08:50:19.726738 30042 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8e250826b45399598717267f94cd5 (DEFAULT_TABLE table=test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:19.730490 30042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8e250826b45399598717267f94cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:19.730852 30262 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8e250826b45399598717267f94cd5 (DEFAULT_TABLE table=test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:19.732299 30262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8e250826b45399598717267f94cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:19.732049 30471 tablet_service.cc:1467] Processing CreateTablet for tablet f4a8e250826b45399598717267f94cd5 (DEFAULT_TABLE table=test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:19.733399 30471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4a8e250826b45399598717267f94cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:19.760932 30634 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Bootstrap starting.
I20260808 08:50:19.763442 30636 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Bootstrap starting.
I20260808 08:50:19.765473 30635 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Bootstrap starting.
I20260808 08:50:19.765568 30634 tablet_bootstrap.cc:654] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:19.766875 30636 tablet_bootstrap.cc:654] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:19.766875 30634 log.cc:824] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:19.768186 30636 log.cc:824] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:19.770817 30635 tablet_bootstrap.cc:654] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:19.772287 30635 log.cc:824] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:19.775620 30634 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: No bootstrap required, opened a new log
I20260808 08:50:19.775942 30636 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: No bootstrap required, opened a new log
I20260808 08:50:19.775934 30634 ts_tablet_manager.cc:1397] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.010s
I20260808 08:50:19.776275 30636 ts_tablet_manager.cc:1397] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260808 08:50:19.785393 30635 tablet_bootstrap.cc:492] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: No bootstrap required, opened a new log
I20260808 08:50:19.785636 30635 ts_tablet_manager.cc:1397] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.005s
I20260808 08:50:19.785828 30634 raft_consensus.cc:348] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.786423 30634 raft_consensus.cc:374] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:19.786567 30634 raft_consensus.cc:729] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c3df7cc53248ceb2d289be154e917f, State: Initialized, Role: FOLLOWER
I20260808 08:50:19.787269 30634 consensus_queue.cc:260] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.788534 30636 raft_consensus.cc:348] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.788910 30636 raft_consensus.cc:374] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:19.789024 30636 raft_consensus.cc:729] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388041004e00420f9a4ae0c3c21a17a5, State: Initialized, Role: FOLLOWER
I20260808 08:50:19.789685 30636 consensus_queue.cc:260] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.793684 30370 heartbeater.cc:503] Master 127.8.149.126:41199 was elected leader, sending a full tablet report...
I20260808 08:50:19.794596 30636 ts_tablet_manager.cc:1428] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260808 08:50:19.795462 30148 heartbeater.cc:503] Master 127.8.149.126:41199 was elected leader, sending a full tablet report...
I20260808 08:50:19.796165 30634 ts_tablet_manager.cc:1428] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Time spent starting tablet: real 0.020s user 0.017s sys 0.003s
I20260808 08:50:19.800084 30635 raft_consensus.cc:348] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.800498 30635 raft_consensus.cc:374] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:19.800599 30635 raft_consensus.cc:729] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78549bba95b94508b535c6e0ae465156, State: Initialized, Role: FOLLOWER
I20260808 08:50:19.800845 30641 raft_consensus.cc:482] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:50:19.801123 30641 raft_consensus.cc:504] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.801177 30635 consensus_queue.cc:260] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.802225 30589 heartbeater.cc:503] Master 127.8.149.126:41199 was elected leader, sending a full tablet report...
I20260808 08:50:19.802754 30635 ts_tablet_manager.cc:1428] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Time spent starting tablet: real 0.017s user 0.009s sys 0.003s
I20260808 08:50:19.809435 30641 leader_election.cc:288] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15c3df7cc53248ceb2d289be154e917f (127.8.149.65:35855), 78549bba95b94508b535c6e0ae465156 (127.8.149.67:33529)
I20260808 08:50:19.814090 30644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.803160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:35855 (local address 127.8.149.66:40585)
0808 08:50:19.803719 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.803740 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.803863 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.806524 (+ 2661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.806533 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.806570 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:19.808302 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.808322 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.809649 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.809655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.811584 (+ 1929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.811598 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.813225 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.813232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.813409 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.813433 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.813562 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.813706 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":447,"threads_started":1}
I20260808 08:50:19.814651 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.803509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:40585 (local address 127.8.149.65:35855)
0808 08:50:19.803954 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.803962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.803996 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:50:19.804062 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.804069 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.804167 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.804258 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:19.808490 (+ 4232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.809486 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.811772 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.812984 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.813157 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.813243 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.814293 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.814421 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301}
I20260808 08:50:19.815393 30076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a8e250826b45399598717267f94cd5" candidate_uuid: "388041004e00420f9a4ae0c3c21a17a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c3df7cc53248ceb2d289be154e917f" is_pre_election: true
I20260808 08:50:19.815847 30076 raft_consensus.cc:2454] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388041004e00420f9a4ae0c3c21a17a5 in term 0.
I20260808 08:50:19.816519 30198 leader_election.cc:302] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c3df7cc53248ceb2d289be154e917f, 388041004e00420f9a4ae0c3c21a17a5; no voters:
I20260808 08:50:19.816879 30641 raft_consensus.cc:2781] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:50:19.817054 30641 raft_consensus.cc:482] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:50:19.817188 30641 raft_consensus.cc:3037] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:19.819193 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.804418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:39673 (local address 127.8.149.67:33529)
0808 08:50:19.805563 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.805571 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.812397 (+ 6826us) server_negotiation.cc:407] Connection header received
0808 08:50:19.812584 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.812591 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.812660 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.812746 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:19.813529 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.814603 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.816925 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.818171 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.818329 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.818407 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.818835 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.818969 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":987}
I20260808 08:50:19.819914 30645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.804187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33529 (local address 127.8.149.66:39673)
0808 08:50:19.812282 (+ 8095us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:19.812303 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:19.812440 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:19.812812 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:19.812818 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:19.812847 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:19.813333 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.813350 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.814891 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.814896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.816771 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:19.816785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.818436 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.818443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:19.818636 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.818673 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:50:19.819395 (+ 722us) client_negotiation.cc:240] Negotiation successful
0808 08:50:19.819539 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7951,"thread_start_us":7656,"threads_started":1}
I20260808 08:50:19.820401 30641 raft_consensus.cc:504] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.821053 30641 leader_election.cc:288] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [CANDIDATE]: Term 1 election: Requested vote from peers 15c3df7cc53248ceb2d289be154e917f (127.8.149.65:35855), 78549bba95b94508b535c6e0ae465156 (127.8.149.67:33529)
I20260808 08:50:19.820930 30512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a8e250826b45399598717267f94cd5" candidate_uuid: "388041004e00420f9a4ae0c3c21a17a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78549bba95b94508b535c6e0ae465156" is_pre_election: true
I20260808 08:50:19.821533 30512 raft_consensus.cc:2454] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388041004e00420f9a4ae0c3c21a17a5 in term 0.
I20260808 08:50:19.821720 30076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a8e250826b45399598717267f94cd5" candidate_uuid: "388041004e00420f9a4ae0c3c21a17a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15c3df7cc53248ceb2d289be154e917f"
I20260808 08:50:19.821893 30076 raft_consensus.cc:3037] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:19.824335 30510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a8e250826b45399598717267f94cd5" candidate_uuid: "388041004e00420f9a4ae0c3c21a17a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78549bba95b94508b535c6e0ae465156"
I20260808 08:50:19.824502 30510 raft_consensus.cc:3037] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:19.824771 30076 raft_consensus.cc:2454] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388041004e00420f9a4ae0c3c21a17a5 in term 1.
I20260808 08:50:19.825158 30198 leader_election.cc:302] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15c3df7cc53248ceb2d289be154e917f, 388041004e00420f9a4ae0c3c21a17a5; no voters:
I20260808 08:50:19.825428 30641 raft_consensus.cc:2781] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:19.825977 30641 raft_consensus.cc:686] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 1 LEADER]: Becoming Leader. State: Replica: 388041004e00420f9a4ae0c3c21a17a5, State: Running, Role: LEADER
I20260808 08:50:19.826663 30641 consensus_queue.cc:237] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } }
I20260808 08:50:19.827972 30510 raft_consensus.cc:2454] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388041004e00420f9a4ae0c3c21a17a5 in term 1.
W20260808 08:50:19.831708 30592 tablet.cc:2369] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:19.831947 29818 catalog_manager.cc:5495] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 388041004e00420f9a4ae0c3c21a17a5 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "388041004e00420f9a4ae0c3c21a17a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388041004e00420f9a4ae0c3c21a17a5" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 } health_report { overall_health: UNKNOWN } } }
I20260808 08:50:19.864065 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.856999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34410 (local address 127.8.149.66:40905)
0808 08:50:19.857221 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.857226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.857247 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:50:19.857461 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.857465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.857542 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.857658 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:50:19.858165 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.858969 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.861617 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.862169 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.862262 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.862830 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:50:19.863320 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:50:19.863478 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.863599 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.863678 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:50:19.874024 30510 raft_consensus.cc:1261] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 1 FOLLOWER]: Refusing update from remote peer 388041004e00420f9a4ae0c3c21a17a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:19.874432 30076 raft_consensus.cc:1261] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 1 FOLLOWER]: Refusing update from remote peer 388041004e00420f9a4ae0c3c21a17a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:19.875173 30648 consensus_queue.cc:1035] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78549bba95b94508b535c6e0ae465156" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:19.875746 30641 consensus_queue.cc:1035] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15c3df7cc53248ceb2d289be154e917f" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 35855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:19.891960 30658 mvcc.cc:205] Tried to move back new op lower bound from 7316189265392922624 to 7316189265215066112. Current Snapshot: MvccSnapshot[applied={T|T < 7316189265392922624}]
I20260808 08:50:19.908578 29818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:19.908855 29818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:19.913993 29818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91fdc21f80d243038b54e9e02931ff13: Sending DeleteTablet for 3 replicas of tablet f4a8e250826b45399598717267f94cd5
I20260808 08:50:19.915321 30042 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8e250826b45399598717267f94cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:42796
I20260808 08:50:19.915424 30262 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8e250826b45399598717267f94cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:34396
I20260808 08:50:19.916858 30471 tablet_service.cc:1514] Processing DeleteTablet for tablet f4a8e250826b45399598717267f94cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:45310
I20260808 08:50:19.917335 30674 tablet_replica.cc:330] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: stopping tablet replica
I20260808 08:50:19.917505 30670 tablet_replica.cc:330] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: stopping tablet replica
I20260808 08:50:19.917747 30674 raft_consensus.cc:2229] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:50:19.918010 30670 raft_consensus.cc:2229] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:19.918708 30670 raft_consensus.cc:2258] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:19.918870 30674 raft_consensus.cc:2258] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:19.921097 30670 ts_tablet_manager.cc:1905] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:19.926039 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 29880
I20260808 08:50:19.928345 30675 tablet_replica.cc:330] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: stopping tablet replica
I20260808 08:50:19.928815 30675 raft_consensus.cc:2229] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:19.929509 30675 raft_consensus.cc:2258] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:19.933530 30674 ts_tablet_manager.cc:1905] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:19.940081 30675 ts_tablet_manager.cc:1905] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:19.948172 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:19.929053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.8.149.65:35855)
0808 08:50:19.929268 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:19.929275 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:19.929298 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:50:19.929393 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:19.929399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:19.929483 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:19.929605 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:19.931836 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.932898 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.934596 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:19.935189 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:19.935324 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:19.939458 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:19.939473 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:19.939489 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:19.939536 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:19.944789 (+ 5253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.945496 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.945504 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.945507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.945720 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:19.946217 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:19.946222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:19.946225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:19.946842 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:19.947145 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:19.947510 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 08:50:19.947713 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:50:19.948910 30141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:19.954572 30675 ts_tablet_manager.cc:1918] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:19.954751 30675 log.cc:1196] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/f4a8e250826b45399598717267f94cd5
I20260808 08:50:19.955363 30675 ts_tablet_manager.cc:1939] T f4a8e250826b45399598717267f94cd5 P 78549bba95b94508b535c6e0ae465156: Deleting consensus metadata
I20260808 08:50:19.957554 29802 catalog_manager.cc:4841] TS 78549bba95b94508b535c6e0ae465156 (127.8.149.67:33529): tablet f4a8e250826b45399598717267f94cd5 (table test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]) successfully deleted
I20260808 08:50:19.959395 30674 ts_tablet_manager.cc:1918] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:19.959718 30674 log.cc:1196] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/f4a8e250826b45399598717267f94cd5
I20260808 08:50:19.960505 30674 ts_tablet_manager.cc:1939] T f4a8e250826b45399598717267f94cd5 P 388041004e00420f9a4ae0c3c21a17a5: Deleting consensus metadata
I20260808 08:50:19.962549 29799 catalog_manager.cc:4841] TS 388041004e00420f9a4ae0c3c21a17a5 (127.8.149.66:40905): tablet f4a8e250826b45399598717267f94cd5 (table test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]) successfully deleted
I20260808 08:50:20.044772 30670 ts_tablet_manager.cc:1918] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:20.044996 30670 log.cc:1196] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/f4a8e250826b45399598717267f94cd5
I20260808 08:50:20.045639 30670 ts_tablet_manager.cc:1939] T f4a8e250826b45399598717267f94cd5 P 15c3df7cc53248ceb2d289be154e917f: Deleting consensus metadata
I20260808 08:50:20.047958 29802 catalog_manager.cc:4841] TS 15c3df7cc53248ceb2d289be154e917f (127.8.149.65:35855): tablet f4a8e250826b45399598717267f94cd5 (table test-table [id=d4ddf7f1829744fc97b16b68ab12b39f]) successfully deleted
I20260808 08:50:20.052388 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 29880
I20260808 08:50:20.081529 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 30152
I20260808 08:50:20.095022 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:20.082246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34426 (local address 127.8.149.66:40905)
0808 08:50:20.082769 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:20.082773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:20.082787 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:50:20.082834 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:20.082838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:20.082932 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:20.083040 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:20.084359 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:20.085103 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:20.086340 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:20.086870 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:20.087009 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:20.089442 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:20.089458 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:20.089473 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:20.089505 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:20.092335 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:20.093054 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:20.093062 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:20.093064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:20.093198 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:20.093560 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:20.093565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:20.093568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:20.093906 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:20.094233 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:20.094492 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 08:50:20.094685 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417}
I20260808 08:50:20.095713 30364 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:20.200915 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 30152
I20260808 08:50:20.231016 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 30376
I20260808 08:50:20.245445 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:20.232418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.8.149.67:33529)
0808 08:50:20.232600 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:20.232607 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:20.232673 (+ 66us) server_negotiation.cc:407] Connection header received
0808 08:50:20.232886 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:20.232891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:20.232976 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:20.233062 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:20.234868 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:20.235604 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:20.237032 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:20.237453 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:20.237550 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:20.240029 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:20.240040 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:20.240056 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:20.240112 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:20.242856 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:20.243517 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:20.243524 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:20.243526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:20.243642 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:20.243993 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:20.243997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:20.243999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:20.244436 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:20.244689 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:20.244979 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 08:50:20.245170 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:50:20.246165 30583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:20.330292 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 30376
I20260808 08:50:20.358312 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 29766
I20260808 08:50:20.359504 29869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:20.466346 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 29766
I20260808 08:50:20.503588 8789 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:50:20.848174 8789 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:50:20.848451 8789 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:50:21.203213 8789 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:50:21.203 UTC [28180] LOG: received smart shutdown request
2026-08-08 08:50:21.206 UTC [28180] LOG: background worker "logical replication launcher" (PID 28196) exited with exit code 1
2026-08-08 08:50:21.206 UTC [28187] LOG: shutting down
2026-08-08 08:50:21.361 UTC [28180] LOG: database system is shut down
2026-08-08T08:50:21Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52291 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:50:21 dist-test-slave-7vjv krb5kdc[30695](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:50:21 dist-test-slave-7vjv krb5kdc[30695](info): set up 2 sockets
Aug 08 08:50:21 dist-test-slave-7vjv krb5kdc[30695](info): commencing operation
krb5kdc: starting...
W20260808 08:50:22.765537 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:50:22 dist-test-slave-7vjv krb5kdc[30695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:50:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:50:22.999405 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39091
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:23.320986 30718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:23.321249 30718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:23.321326 30718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:23.327773 30718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:23.327857 30718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:23.327899 30718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:23.327943 30718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:23.327984 30718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:23.337246 30718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:23.338357 30718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:23.339489 30718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:23.352566 30727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:23.352566 30733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:23.352599 30731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:23.353500 30718 server_base.cc:1034] running on GCE node
I20260808 08:50:23.354175 30718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:23.355432 30718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:23.356623 30718 hybrid_clock.cc:648] HybridClock initialized: now 1786179023356588 us; error 32 us; skew 500 ppm
I20260808 08:50:23.356928 30718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:23 dist-test-slave-7vjv krb5kdc[30695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:23.359766 30718 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:23.361269 30718 webserver.cc:460] Webserver started at http://127.8.149.126:46265/ using document root <none> and password file <none>
I20260808 08:50:23.361996 30718 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:23.362176 30718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:23.362497 30718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:23.365274 30718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "d72811263b64434382adffcbcb291fa1"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "62197c94cd6e8f6c180224f84475e5e0"
server_key_iv: "e88f74582eac6e32d0818bf1044144bc"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.366123 30718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "d72811263b64434382adffcbcb291fa1"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "62197c94cd6e8f6c180224f84475e5e0"
server_key_iv: "e88f74582eac6e32d0818bf1044144bc"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.370815 30718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:50:23.373931 30741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:23.375108 30718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:50:23.375267 30718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "d72811263b64434382adffcbcb291fa1"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "62197c94cd6e8f6c180224f84475e5e0"
server_key_iv: "e88f74582eac6e32d0818bf1044144bc"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.375416 30718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:23.399950 30718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:23.403689 30718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:23.403977 30718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:23.422844 30718 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39091
I20260808 08:50:23.422892 30815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39091 every 8 connection(s)
I20260808 08:50:23.424173 30718 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:23.427627 30816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:23.431303 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 30718
I20260808 08:50:23.431521 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:50:23.432318 8789 external_mini_cluster.cc:1428] Setting key 483356bee744a54632280ed26e5fcfca
I20260808 08:50:23.435109 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:23 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:23.462014 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.439112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39091 (local address 127.0.0.1:43988)
0808 08:50:23.440065 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.440149 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:23.442874 (+ 2725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:23.443808 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:23.443815 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:23.444562 (+ 747us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:23.444914 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.444938 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.447280 (+ 2342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.447285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.448543 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.448564 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.449983 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.449990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.450105 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.450771 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:23.450794 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:23.453221 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:23.457835 (+ 4614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.457845 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.457852 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.458245 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.458791 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.458795 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.458797 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.458974 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.459995 (+ 1021us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:23.460000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:23.460323 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 08:50:23.460533 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 08:50:23.460912 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":414,"threads_started":1}
I20260808 08:50:23.462118 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.439112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43988 (local address 127.8.149.126:39091)
0808 08:50:23.440967 (+ 1855us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:23.440975 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:23.441017 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:50:23.443240 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:23.443248 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:23.443517 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:23.443682 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:23.445158 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.447083 (+ 1925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.448701 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.449700 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.449899 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.453498 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:23.453515 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:23.453531 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:23.453570 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:23.457687 (+ 4117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.458409 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.458419 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.458443 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.458662 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.459111 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.459118 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.459122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.459809 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:23.460046 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:23.460789 (+ 743us) server_negotiation.cc:299] Negotiation successful
0808 08:50:23.461133 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1651,"spinlock_wait_cycles":22272,"thread_start_us":1442,"threads_started":1}
WARNING: no policy specified for kudu/127.8.149.125@KRBTEST.COM; defaulting to no policy
I20260808 08:50:23.465021 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.125@KRBTEST.COM" created.
I20260808 08:50:23.466002 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.465647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37124)
0808 08:50:23.465814 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.465912 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 08:50:23.466218 30744 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
I20260808 08:50:23.467686 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.467341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37128)
0808 08:50:23.467498 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.467569 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:50:23.467906 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:40297: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
I20260808 08:50:23.494850 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:40297
--webserver_interface=127.8.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:23.517269 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } attempt: 1
I20260808 08:50:23.518450 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.517990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37144)
0808 08:50:23.518205 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.518314 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 08:50:23.519454 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.519112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37150)
0808 08:50:23.519249 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.519311 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:50:23.519659 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:40297: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
I20260808 08:50:23.587926 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } attempt: 2
I20260808 08:50:23.589215 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.588637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37160)
0808 08:50:23.588981 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.589075 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260808 08:50:23.590305 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.589936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37162)
0808 08:50:23.590091 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.590167 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:50:23.590502 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:40297: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
I20260808 08:50:23.681725 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } attempt: 3
I20260808 08:50:23.682816 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.682381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37170)
0808 08:50:23.682581 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.682680 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 08:50:23.683986 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.683620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37180)
0808 08:50:23.683777 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.683851 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:50:23.684180 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:40297: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
W20260808 08:50:23.817027 30824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:23.817356 30824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:23.817520 30824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:23.823971 30824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:23.824095 30824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:23.824213 30824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:23.824307 30824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:23.824393 30824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:23.827404 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } attempt: 4
I20260808 08:50:23.828724 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.828022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37182)
0808 08:50:23.828440 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.828544 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224}
I20260808 08:50:23.829947 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.829517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37184)
0808 08:50:23.829681 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.829793 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:50:23.830171 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:40297: Network error: Client connection negotiation failed: client connection to 127.8.149.125:40297: connect: Connection refused (error 111)
I20260808 08:50:23.834167 30824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:40297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:23.835321 30824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:23.836687 30824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:23.847961 30830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:23.848022 30833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:23.848043 30838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:23.849174 30824 server_base.cc:1034] running on GCE node
I20260808 08:50:23.849876 30824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:23.851058 30824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:23.852276 30824 hybrid_clock.cc:648] HybridClock initialized: now 1786179023852231 us; error 65 us; skew 500 ppm
I20260808 08:50:23.852598 30824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:23 dist-test-slave-7vjv krb5kdc[30695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:23.855455 30824 init.cc:377] Logged in from keytab as kudu/127.8.149.125@KRBTEST.COM (short username kudu)
I20260808 08:50:23.856890 30824 webserver.cc:460] Webserver started at http://127.8.149.125:40635/ using document root <none> and password file <none>
I20260808 08:50:23.857499 30824 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:23.857626 30824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:23.857901 30824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:23.860579 30824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data/instance:
uuid: "7442b84033294e139b56a78ab0a93e4e"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "278e184afa0d882be11831f65dae3c72"
server_key_iv: "38585b8717f7be9a916407c51f0dcb8b"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.861301 30824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal/instance:
uuid: "7442b84033294e139b56a78ab0a93e4e"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "278e184afa0d882be11831f65dae3c72"
server_key_iv: "38585b8717f7be9a916407c51f0dcb8b"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.865752 30824 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:50:23.869220 30851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:23.870379 30824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:23.870558 30824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "7442b84033294e139b56a78ab0a93e4e"
format_stamp: "Formatted at 2026-08-08 08:50:23 on dist-test-slave-7vjv"
server_key: "278e184afa0d882be11831f65dae3c72"
server_key_iv: "38585b8717f7be9a916407c51f0dcb8b"
server_key_version: "encryptionkey@0"
I20260808 08:50:23.870752 30824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:23.899411 30824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:23.903805 30824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:23.904063 30824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:23.922828 30824 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.125:40297
I20260808 08:50:23.922933 30928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.125:40297 every 8 connection(s)
I20260808 08:50:23.924053 30824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
I20260808 08:50:23.927309 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 30824
I20260808 08:50:23.927511 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-1/wal/instance
I20260808 08:50:23.927661 30929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:23.928030 8789 external_mini_cluster.cc:1428] Setting key 0da43260d027a201cb321bdc77841658
I20260808 08:50:23.933846 30929 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:23 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.8.149.124@KRBTEST.COM; defaulting to no policy
I20260808 08:50:23.952702 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.936245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.8.149.126:39091)
0808 08:50:23.936429 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:23.936433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:23.937778 (+ 1345us) server_negotiation.cc:407] Connection header received
0808 08:50:23.939573 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:23.939578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:23.939677 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:23.939789 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:23.941315 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.942015 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.943460 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.943873 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.944017 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.947178 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:23.947183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:23.947186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:23.947218 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:23.949804 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.950540 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.950550 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.950552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.950665 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.951111 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.951115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.951119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.951380 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:23.951556 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:23.952195 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 08:50:23.952417 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:50:23.953663 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.936856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39091 (local address 127.0.0.1:43990)
0808 08:50:23.937603 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.937640 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:23.939307 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:23.940004 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:23.940011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:23.940592 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:23.941140 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.941161 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.942192 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.942196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.943303 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.943325 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.944112 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.944121 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.944326 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.944976 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:23.944997 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:23.946968 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:23.949962 (+ 2994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.949970 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.949982 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.950414 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.950775 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.950780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.950783 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.950977 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.951522 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:23.951531 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:23.951826 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 08:50:23.952074 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 08:50:23.952494 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":332,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.124@KRBTEST.COM" created.
I20260808 08:50:23.955336 30929 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:23 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:50:23.970139 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.956216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37186 (local address 127.8.149.125:40297)
0808 08:50:23.956938 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:23.956948 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:23.956981 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:50:23.957050 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:23.957058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:23.957265 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:23.957443 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:23.958106 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.959758 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.960897 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.961792 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.961960 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.964730 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:23.964743 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:23.964777 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:23.964817 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:23.967434 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.968250 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.968255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.968257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.968357 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:23.968767 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:23.968770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:23.968772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:23.969055 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:23.969205 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:23.969618 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 08:50:23.969878 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":132,"server-negotiator.queue_time_us":529,"thread_start_us":383,"threads_started":1}
I20260808 08:50:23.970218 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.956192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37186)
0808 08:50:23.956386 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.956408 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:23.956529 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:23.957421 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:23.957424 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:23.957789 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:23.957952 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.957961 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.959888 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.959898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.960756 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:23.960768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:23.961991 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:23.961995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:23.962162 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:23.962693 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:23.962709 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:23.964518 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:23.967556 (+ 3038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.967563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.967569 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.968124 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.968471 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:23.968478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:23.968484 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:23.968663 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:23.969184 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:23.969192 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:23.969348 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 08:50:23.969489 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:50:23.969774 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":3}
I20260808 08:50:23.972501 30929 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:50:23.973740 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.973166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46558)
0808 08:50:23.973378 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.973554 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:50:23.974045 30854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:23.975728 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:23.975266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46562)
0808 08:50:23.975453 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:23.975564 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:50:23.975934 30929 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
I20260808 08:50:23.987727 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:44299
--webserver_interface=127.8.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:34433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:24.025257 30929 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 1
I20260808 08:50:24.026628 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.026061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46572)
0808 08:50:24.026296 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.026438 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 08:50:24.027725 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.027319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46586)
0808 08:50:24.027501 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.027580 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:50:24.027997 30929 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.096277 30929 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 2
I20260808 08:50:24.097645 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.097047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46598)
0808 08:50:24.097309 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.097451 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:50:24.098733 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.098335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46606)
0808 08:50:24.098508 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.098597 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:50:24.099004 30929 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.129480 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } attempt: 5
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:50:24.144928 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.130196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37190)
0808 08:50:24.130455 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.130480 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.130655 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.131057 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.131066 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.131705 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.131967 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.131982 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.133005 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.133010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.134407 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.134422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.135173 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.135179 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.135381 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.136091 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.136144 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.138737 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.142671 (+ 3934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.142675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.142678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.143025 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.143440 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.143443 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.143445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.143566 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.144248 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.144251 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.144375 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.144501 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.144685 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 08:50:24.145246 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.130312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.8.149.125:40297)
0808 08:50:24.130491 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.130495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.130570 (+ 75us) server_negotiation.cc:407] Connection header received
0808 08:50:24.130809 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.130813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.130873 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.130959 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.132187 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.132867 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.134571 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.135015 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.135117 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.138958 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.138968 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.138974 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.139023 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.142525 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.143157 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.143165 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.143169 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.143323 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.143668 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.143672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.143675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.144071 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.144268 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.144642 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.144860 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:50:24.146289 30816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:50:24.147507 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.147020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46608)
0808 08:50:24.147214 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.147319 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 08:50:24.148690 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.148301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46620)
0808 08:50:24.148467 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.148567 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:50:24.149020 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.190248 30929 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 3
I20260808 08:50:24.191431 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.190901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46626)
0808 08:50:24.191115 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.191222 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 08:50:24.192569 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.192076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46636)
0808 08:50:24.192343 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.192439 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
W20260808 08:50:24.192772 30929 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.200196 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 1
I20260808 08:50:24.201345 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.200803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46652)
0808 08:50:24.201029 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.201139 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:50:24.202443 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.202026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46656)
0808 08:50:24.202191 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.202302 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:50:24.202708 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.271009 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 2
I20260808 08:50:24.272411 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.271763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46664)
0808 08:50:24.272029 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.272194 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:50:24.273638 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.273152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46680)
0808 08:50:24.273375 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.273468 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260808 08:50:24.273907 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
W20260808 08:50:24.320495 30941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:24.320765 30941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:24.320926 30941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:24.327293 30941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:24.327390 30941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:24.327503 30941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:24.327574 30941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:24.327634 30941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:24.335984 30929 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 4
I20260808 08:50:24.337441 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.336712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46682)
0808 08:50:24.337028 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.337158 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:50:24.338685 30941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:34433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39091,127.8.149.125:40297,127.8.149.124:44299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:44299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:24.339016 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.338409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46688)
0808 08:50:24.338615 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.338754 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 08:50:24.339303 30929 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.340163 30941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:24.341729 30941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:24.354075 30953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:24.354106 30949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:24.354166 30948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:24.355041 30941 server_base.cc:1034] running on GCE node
I20260808 08:50:24.355891 30941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:24.357200 30941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:24.358433 30941 hybrid_clock.cc:648] HybridClock initialized: now 1786179024358342 us; error 78 us; skew 500 ppm
I20260808 08:50:24.358750 30941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179024, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:24.366010 30941 init.cc:377] Logged in from keytab as kudu/127.8.149.124@KRBTEST.COM (short username kudu)
I20260808 08:50:24.367483 30941 webserver.cc:460] Webserver started at http://127.8.149.124:35293/ using document root <none> and password file <none>
I20260808 08:50:24.368170 30941 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:24.368289 30941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:24.368649 30941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:24.371629 30941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data/instance:
uuid: "207fd05f106c48c78e4def9f073b6254"
format_stamp: "Formatted at 2026-08-08 08:50:24 on dist-test-slave-7vjv"
server_key: "6df744b7c6f6d746eafccb5b99d5a515"
server_key_iv: "b3165a7f5c84e29b616f2198a3504832"
server_key_version: "encryptionkey@0"
I20260808 08:50:24.372501 30941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal/instance:
uuid: "207fd05f106c48c78e4def9f073b6254"
format_stamp: "Formatted at 2026-08-08 08:50:24 on dist-test-slave-7vjv"
server_key: "6df744b7c6f6d746eafccb5b99d5a515"
server_key_iv: "b3165a7f5c84e29b616f2198a3504832"
server_key_version: "encryptionkey@0"
I20260808 08:50:24.377584 30941 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:50:24.380147 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 3
I20260808 08:50:24.381157 30963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:24.381336 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.380774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46696)
0808 08:50:24.381024 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.381126 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 08:50:24.382475 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.382108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46706)
0808 08:50:24.382303 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.382387 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260808 08:50:24.382656 30816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44299: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44299: connect: Connection refused (error 111)
I20260808 08:50:24.382862 30941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:50:24.383031 30941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "207fd05f106c48c78e4def9f073b6254"
format_stamp: "Formatted at 2026-08-08 08:50:24 on dist-test-slave-7vjv"
server_key: "6df744b7c6f6d746eafccb5b99d5a515"
server_key_iv: "b3165a7f5c84e29b616f2198a3504832"
server_key_version: "encryptionkey@0"
I20260808 08:50:24.383229 30941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:24.395771 30941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:24.399667 30941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:24.399973 30941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:24.418521 30941 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.124:44299
I20260808 08:50:24.418566 31051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.124:44299 every 8 connection(s)
I20260808 08:50:24.419824 30941 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
I20260808 08:50:24.422255 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 30941
I20260808 08:50:24.422477 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178813799529-8789-0/minicluster-data/master-2/wal/instance
I20260808 08:50:24.422981 8789 external_mini_cluster.cc:1428] Setting key 47dd6e9decdcfd6cc0d6e171b3ff8f3f
I20260808 08:50:24.423863 31052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:24.433740 31052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179024, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:24.444463 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.424921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46714 (local address 127.8.149.124:44299)
0808 08:50:24.425669 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.425679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.425719 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:50:24.427174 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.427193 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.427516 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.427902 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.429353 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.430598 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.431875 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.432580 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.432770 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.437443 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.437462 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.437471 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.437506 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.440505 (+ 2999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.441223 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.441229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.441234 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.441387 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.441788 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.441795 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.441797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.442380 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.442685 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.443128 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.443489 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":1208,"threads_started":1}
I20260808 08:50:24.450707 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.436145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44000 (local address 127.8.149.126:39091)
0808 08:50:24.436361 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.436368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.436815 (+ 447us) server_negotiation.cc:407] Connection header received
0808 08:50:24.437019 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.437026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.437092 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.437197 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.438323 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.439028 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.440481 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.440971 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.441113 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.444475 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.444485 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.444488 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.444516 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.447726 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.448744 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.448760 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.448765 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.448942 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.449317 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.449324 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.449330 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.449634 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.449807 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.450265 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.450440 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:50:24.450847 31060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.436002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39091 (local address 127.0.0.1:44000)
0808 08:50:24.436679 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.436712 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.436889 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.437264 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.437271 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.437890 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.438178 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.438187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.439188 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.439195 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.440335 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.440348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.441149 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.441156 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.441311 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.441893 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.441914 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.444301 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.447925 (+ 3624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.447935 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.447941 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.448566 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.449056 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.449059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.449061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.449203 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.449754 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.449761 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.449969 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.450149 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.450448 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":363,"threads_started":1}
I20260808 08:50:24.452441 31052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179024, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:50:24.463569 31062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.447394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44004 (local address 127.8.149.126:39091)
0808 08:50:24.448056 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.448061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.448085 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:50:24.448169 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.448173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.448234 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.448359 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.449872 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.451109 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.452945 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.453548 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.453660 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.457680 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.457685 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.457691 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.457723 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.460933 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.461591 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.461595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.461597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.461766 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.462190 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.462196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.462199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.462526 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.462803 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.462993 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.463179 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":300,"threads_started":1}
I20260808 08:50:24.465981 31060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.453185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:40297 (local address 127.0.0.1:37204)
0808 08:50:24.453397 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.453414 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.453526 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.453876 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.453879 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.454171 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.454289 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.454297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.455256 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.455281 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.456191 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.456202 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.456868 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.456873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.457088 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.457611 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.457626 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.459678 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.463294 (+ 3616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.463299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.463302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.463763 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.464247 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.464251 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.464253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.464428 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.465035 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.465039 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.465174 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.465353 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.465639 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260808 08:50:24.466692 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.453172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37204 (local address 127.8.149.125:40297)
0808 08:50:24.453339 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.453343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.453481 (+ 138us) server_negotiation.cc:407] Connection header received
0808 08:50:24.453649 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.453655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.453737 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.453846 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.454438 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.455105 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.456320 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.456715 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.456840 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.459871 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.459878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.459885 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.459928 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.463149 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.463875 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.463880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.463884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.464071 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.464560 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.464564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.464567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.464870 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.465049 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.466297 (+ 1248us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.466439 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:50:24.467717 31052 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179024, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:50:24.480451 31063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.465091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37208 (local address 127.8.149.125:40297)
0808 08:50:24.465672 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.465677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.465700 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:50:24.465745 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.465749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.465809 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.465912 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.467281 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.468319 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.469571 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.470000 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.470084 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.474574 (+ 4490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.474579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.474581 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.474627 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.477768 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.478443 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.478447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.478449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.478571 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.478927 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.478931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.478934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.479295 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.479549 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.479826 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.480056 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":258,"threads_started":1}
I20260808 08:50:24.481110 31060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.468502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46728)
0808 08:50:24.468640 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.468673 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.468771 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.469040 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.469044 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.469391 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.469551 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.469561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.470603 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.470609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.471507 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.471518 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.472540 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.472544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.472657 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.473137 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.473151 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.475154 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.478357 (+ 3203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.478364 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.478371 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.478843 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.479235 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.479238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.479240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.479405 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.480049 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.480053 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.480258 (+ 205us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.480391 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.480682 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:50:24.481227 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.468417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46728 (local address 127.8.149.124:44299)
0808 08:50:24.468575 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.468586 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.468729 (+ 143us) server_negotiation.cc:407] Connection header received
0808 08:50:24.468867 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.468871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.468921 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.469029 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.469683 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.470435 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.471650 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.472367 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.472492 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.475327 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.475331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.475334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.475385 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.478241 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.478949 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.478954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.478957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.479127 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.479520 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.479524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.479527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.479921 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.480060 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.480553 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.480835 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":35}
I20260808 08:50:24.485322 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:50:24.486850 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: Bootstrap starting.
I20260808 08:50:24.491222 31052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:24.492730 31052 log.cc:824] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:24.500017 31052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: No bootstrap required, opened a new log
I20260808 08:50:24.511471 31063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.491608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.8.149.125:40297)
0808 08:50:24.492088 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.492128 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.493078 (+ 950us) server_negotiation.cc:407] Connection header received
0808 08:50:24.493427 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.493435 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.493527 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.493612 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.496368 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.497490 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.499135 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.499707 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.499842 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.503519 (+ 3677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.503525 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.503530 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.503571 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.507648 (+ 4077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.508541 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.508547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.508550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.508741 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.509222 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.509227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.509230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.509603 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.509840 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.510868 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.511097 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312}
I20260808 08:50:24.511322 31052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.511921 31052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:24.512176 31052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 207fd05f106c48c78e4def9f073b6254, State: Initialized, Role: FOLLOWER
I20260808 08:50:24.512279 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.491577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46738 (local address 127.8.149.124:44299)
0808 08:50:24.491869 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.491878 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.495576 (+ 3698us) server_negotiation.cc:407] Connection header received
0808 08:50:24.495780 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.495784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.495854 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.495950 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.498263 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.499267 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.501124 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.501561 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.501711 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.504643 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.504650 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.504655 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.504694 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.508574 (+ 3880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.509492 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.509497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.509501 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.509668 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.510252 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.510260 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.510266 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.510647 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.510897 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.511609 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.511838 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260808 08:50:24.512928 31052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.514030 31075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.514529 31075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.515404 31052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:24.519519 31062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.491072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.8.149.126:39091)
0808 08:50:24.491263 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.491269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.496637 (+ 5368us) server_negotiation.cc:407] Connection header received
0808 08:50:24.497836 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.497844 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.497932 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.498013 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.505770 (+ 7757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.506820 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.508769 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.509446 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.509554 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.513109 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.513116 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.513121 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.513173 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.516447 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.517140 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.517145 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.517149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.517307 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.517850 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.517857 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.517860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.518170 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.518352 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.518826 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.519086 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 08:50:24.526201 31092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:50:24.526332 31092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:50:24.522962 30941 master_runner.cc:186] Error getting master registration for 127.8.149.126:39091: OK, instance_id { permanent_uuid: "d72811263b64434382adffcbcb291fa1" instance_seqno: 1786179023417709 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:50:24.531507 30941 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:50:24.559849 30816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 4
I20260808 08:50:24.562489 31075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:50:24.562793 31075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.564452 31075 leader_election.cc:288] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d72811263b64434382adffcbcb291fa1 (127.8.149.126:39091), 7442b84033294e139b56a78ab0a93e4e (127.8.149.125:40297)
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:50:24.576522 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.560515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46754 (local address 127.8.149.124:44299)
0808 08:50:24.560691 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.560699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.560719 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:50:24.560904 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.560909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.561004 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.561108 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.561856 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.562957 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.564762 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.565492 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.565640 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.570012 (+ 4372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.570019 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.570025 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.570062 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.573493 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.574404 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.574409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.574412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.574593 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.575052 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.575057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.575060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.575365 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.575523 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.575973 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.576198 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:50:24.576538 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.560442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46754)
0808 08:50:24.560647 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.560668 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.560782 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.561132 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.561137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.561550 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.561703 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.561711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.563118 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.563124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.564560 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.564578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.565928 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.565935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.566146 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.566889 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.566916 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.569815 (+ 2899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.573657 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.573663 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.573668 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.574212 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.574715 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.574736 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.574740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.574945 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.575513 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.575518 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.575714 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.575863 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.576156 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:50:24.583628 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: Bootstrap starting.
I20260808 08:50:24.587715 30816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:24.589702 30816 log.cc:824] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:24.593180 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: No bootstrap required, opened a new log
I20260808 08:50:24.603945 30816 raft_consensus.cc:348] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.604337 30816 raft_consensus.cc:374] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:24.604470 30816 raft_consensus.cc:729] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72811263b64434382adffcbcb291fa1, State: Initialized, Role: FOLLOWER
I20260808 08:50:24.605108 30816 consensus_queue.cc:260] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.606037 31095 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.606468 31095 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.607333 30816 sys_catalog.cc:564] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:24.607362 30776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "207fd05f106c48c78e4def9f073b6254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72811263b64434382adffcbcb291fa1" is_pre_election: true
I20260808 08:50:24.608048 30776 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 207fd05f106c48c78e4def9f073b6254 in term 0.
I20260808 08:50:24.608851 30972 leader_election.cc:302] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 207fd05f106c48c78e4def9f073b6254, d72811263b64434382adffcbcb291fa1; no voters:
I20260808 08:50:24.609417 31075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:50:24.609581 31075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:50:24.609702 31075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:24.614233 31075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.615772 30776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "207fd05f106c48c78e4def9f073b6254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d72811263b64434382adffcbcb291fa1"
I20260808 08:50:24.616132 30776 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:24.616639 31075 leader_election.cc:288] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [CANDIDATE]: Term 1 election: Requested vote from peers d72811263b64434382adffcbcb291fa1 (127.8.149.126:39091), 7442b84033294e139b56a78ab0a93e4e (127.8.149.125:40297)
I20260808 08:50:24.619944 30776 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 207fd05f106c48c78e4def9f073b6254 in term 1.
I20260808 08:50:24.621241 30972 leader_election.cc:302] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 207fd05f106c48c78e4def9f073b6254, d72811263b64434382adffcbcb291fa1; no voters:
I20260808 08:50:24.622450 31075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:24.624084 31075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [term 1 LEADER]: Becoming Leader. State: Replica: 207fd05f106c48c78e4def9f073b6254, State: Running, Role: LEADER
I20260808 08:50:24.624845 31075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.630908 31100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 207fd05f106c48c78e4def9f073b6254. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.631862 31100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:24.635938 31102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:24.638350 31102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:24.638558 30929 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } attempt: 5
I20260808 08:50:24.647042 31119 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
Aug 08 08:50:24 dist-test-slave-7vjv krb5kdc[30695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179023, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
W20260808 08:50:24.652660 30974 tablet.cc:2369] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:50:24.656679 30749 tablet.cc:2369] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:24.659044 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.640257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46762 (local address 127.8.149.124:44299)
0808 08:50:24.640416 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:24.640422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:24.640439 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:50:24.640492 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:24.640497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:24.640560 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:24.640661 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:24.641918 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.643000 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.645218 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.645902 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.646023 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.649923 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:24.649929 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:24.649933 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:24.649971 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:24.653988 (+ 4017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.655094 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.655102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.655106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.655246 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:24.655726 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:24.655731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:24.655735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:24.656452 (+ 717us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:24.656674 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:24.657410 (+ 736us) server_negotiation.cc:299] Negotiation successful
0808 08:50:24.657762 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:50:24.660259 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:24.639053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44299 (local address 127.0.0.1:46762)
0808 08:50:24.639212 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:24.639228 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:24.639351 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:24.640703 (+ 1352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:24.640709 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:24.641473 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:24.641756 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.641771 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.643177 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.643196 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.645059 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:24.645078 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:24.646061 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:24.646070 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:24.646373 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:24.647070 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:24.647093 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:24.649717 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:24.654136 (+ 4419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.654141 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.654145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.654850 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.655417 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:24.655423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:24.655428 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:24.655591 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:24.656758 (+ 1167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:24.656762 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:24.657021 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 08:50:24.657915 (+ 894us) client_negotiation.cc:240] Negotiation successful
0808 08:50:24.658994 (+ 1079us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 08:50:24.654636 30718 master_runner.cc:186] Error getting master registration for 127.8.149.125:40297: OK, instance_id { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" instance_seqno: 1786179023917518 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:50:24.663107 30718 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:50:24.666158 30929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: Bootstrap starting.
I20260808 08:50:24.666718 30776 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [term 1 FOLLOWER]: Refusing update from remote peer 207fd05f106c48c78e4def9f073b6254: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:24.667609 31100 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:24.669878 30929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:24.671033 30929 log.cc:824] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:24.680085 30929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: No bootstrap required, opened a new log
I20260808 08:50:24.681867 31095 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 207fd05f106c48c78e4def9f073b6254. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.682140 31095 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.686729 31075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.687062 31075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:24.688333 31125 mvcc.cc:205] Tried to move back new op lower bound from 7316189285023387648 to 7316189284869922816. Current Snapshot: MvccSnapshot[applied={T|T < 7316189285023387648}]
I20260808 08:50:24.691056 30929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.691601 30929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:24.691757 30929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7442b84033294e139b56a78ab0a93e4e, State: Initialized, Role: FOLLOWER
I20260808 08:50:24.692567 30929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } }
I20260808 08:50:24.693585 31095 sys_catalog.cc:455] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.693889 31095 sys_catalog.cc:458] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.694491 31102 catalog_manager.cc:1347] Generated new cluster ID: 906e84c073fb464bb1c881a34ca15a1f
I20260808 08:50:24.694598 31102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:24.698993 31131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.700862 31131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.700752 30929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:24.701635 30891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:24.702099 30895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "207fd05f106c48c78e4def9f073b6254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7442b84033294e139b56a78ab0a93e4e" is_pre_election: true
I20260808 08:50:24.703378 30893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "207fd05f106c48c78e4def9f073b6254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7442b84033294e139b56a78ab0a93e4e"
I20260808 08:50:24.704962 30891 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [term 1 FOLLOWER]: Refusing update from remote peer 207fd05f106c48c78e4def9f073b6254: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:24.705607 31100 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:24.726068 31131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 207fd05f106c48c78e4def9f073b6254. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.726402 31131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.726747 31138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.727250 31138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:50:24.735682 31100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "207fd05f106c48c78e4def9f073b6254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72811263b64434382adffcbcb291fa1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39091 } } peers { permanent_uuid: "7442b84033294e139b56a78ab0a93e4e" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 40297 } } peers { permanent_uuid: "207fd05f106c48c78e4def9f073b6254" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44299 } } }
I20260808 08:50:24.736016 31100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:24.748545 31102 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:50:24.750545 31102 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:24.768687 31102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 207fd05f106c48c78e4def9f073b6254: Generated new TSK 0
I20260808 08:50:24.769621 31102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:50:24.774358 31157 catalog_manager.cc:1259] Loaded cluster ID: 906e84c073fb464bb1c881a34ca15a1f
I20260808 08:50:24.774461 31157 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: loading cluster ID for follower catalog manager: success
I20260808 08:50:24.777842 31157 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: acquiring CA information for follower catalog manager: success
I20260808 08:50:24.779992 31157 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7442b84033294e139b56a78ab0a93e4e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:50:25.651567 31119 catalog_manager.cc:1259] Loaded cluster ID: 906e84c073fb464bb1c881a34ca15a1f
I20260808 08:50:25.651672 31119 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: loading cluster ID for follower catalog manager: success
I20260808 08:50:25.654222 31119 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: acquiring CA information for follower catalog manager: success
I20260808 08:50:25.656002 31119 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d72811263b64434382adffcbcb291fa1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:50:25.867133 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 30718
I20260808 08:50:25.868485 30811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:25.979226 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 30718
I20260808 08:50:26.007623 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 30824
I20260808 08:50:26.008797 30922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:26.110981 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 30824
I20260808 08:50:26.139019 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 30941
I20260808 08:50:26.140365 31045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:26.250072 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 30941
2026-08-08T08:50:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4757 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:50:26 dist-test-slave-7vjv krb5kdc[31176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:50:26 dist-test-slave-7vjv krb5kdc[31176](info): set up 2 sockets
Aug 08 08:50:26 dist-test-slave-7vjv krb5kdc[31176](info): commencing operation
krb5kdc: starting...
W20260808 08:50:27.536967 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:50:27 dist-test-slave-7vjv krb5kdc[31176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:50:27.783250 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38019
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:38019
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:28.103224 31194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:28.103482 31194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:28.103567 31194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:28.110217 31194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:28.110312 31194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:28.110359 31194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:28.110417 31194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:28.110455 31194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:28.119788 31194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:38019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:28.120965 31194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:28.122223 31194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:28.133627 31201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:28.133725 31200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:28.133733 31208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:28.134296 31194 server_base.cc:1034] running on GCE node
I20260808 08:50:28.134996 31194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:28.136267 31194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:28.137490 31194 hybrid_clock.cc:648] HybridClock initialized: now 1786179028137454 us; error 47 us; skew 500 ppm
I20260808 08:50:28.137826 31194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:28 dist-test-slave-7vjv krb5kdc[31176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179028, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:28.140782 31194 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:28.142107 31194 webserver.cc:460] Webserver started at http://127.8.149.126:41561/ using document root <none> and password file <none>
I20260808 08:50:28.142720 31194 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:28.142858 31194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:28.143153 31194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:28.146219 31194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "c0dc2edccd9245ac8b516f0e9db1bc36"
format_stamp: "Formatted at 2026-08-08 08:50:28 on dist-test-slave-7vjv"
server_key: "5ce285dde2cd8f594f822b0395c0f003"
server_key_iv: "c2683382c4e78702487baeea788945c3"
server_key_version: "encryptionkey@0"
I20260808 08:50:28.146914 31194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "c0dc2edccd9245ac8b516f0e9db1bc36"
format_stamp: "Formatted at 2026-08-08 08:50:28 on dist-test-slave-7vjv"
server_key: "5ce285dde2cd8f594f822b0395c0f003"
server_key_iv: "c2683382c4e78702487baeea788945c3"
server_key_version: "encryptionkey@0"
I20260808 08:50:28.151748 31194 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 08:50:28.155082 31220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:28.156318 31194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:28.156484 31194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "c0dc2edccd9245ac8b516f0e9db1bc36"
format_stamp: "Formatted at 2026-08-08 08:50:28 on dist-test-slave-7vjv"
server_key: "5ce285dde2cd8f594f822b0395c0f003"
server_key_iv: "c2683382c4e78702487baeea788945c3"
server_key_version: "encryptionkey@0"
I20260808 08:50:28.156682 31194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:28.175143 31194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:28.179267 31194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:28.179536 31194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:28.197669 31194 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:38019
I20260808 08:50:28.197692 31306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:38019 every 8 connection(s)
I20260808 08:50:28.198902 31194 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:28.202559 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 31194
I20260808 08:50:28.202627 31308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:28.202793 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:50:28.203644 8789 external_mini_cluster.cc:1428] Setting key 76c8aff7c8e7a57365a80129bfeada29
I20260808 08:50:28.215881 31308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36: Bootstrap starting.
Aug 08 08:50:28 dist-test-slave-7vjv krb5kdc[31176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:28.219373 31308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:28.220786 31308 log.cc:824] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:28.223757 31308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36: No bootstrap required, opened a new log
I20260808 08:50:28.227332 31312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:28.205401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40050 (local address 127.8.149.126:38019)
0808 08:50:28.206272 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:28.206282 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:28.206321 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:50:28.208485 (+ 2164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:28.208504 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:28.208838 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:28.209143 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:28.210894 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:28.212076 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:28.213931 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:28.214553 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:28.214679 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:28.219242 (+ 4563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:28.219253 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:28.219275 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:28.219317 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:28.222929 (+ 3612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:28.223560 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:28.223567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:28.223573 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:28.223774 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:28.224204 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:28.224211 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:28.224219 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:28.224909 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:28.225189 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:28.225552 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 08:50:28.226010 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":431,"threads_started":1}
I20260808 08:50:28.230933 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:50:28.232401 31308 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } }
I20260808 08:50:28.232718 31308 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:28.232836 31308 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0dc2edccd9245ac8b516f0e9db1bc36, State: Initialized, Role: FOLLOWER
I20260808 08:50:28.233358 31308 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } }
I20260808 08:50:28.233646 31308 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:28.233809 31308 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:28.233991 31308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:28.235954 31308 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } }
I20260808 08:50:28.236449 31308 leader_election.cc:302] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0dc2edccd9245ac8b516f0e9db1bc36; no voters:
I20260808 08:50:28.236989 31308 leader_election.cc:288] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:50:28.237128 31315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:28.237787 31315 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [term 1 LEADER]: Becoming Leader. State: Replica: c0dc2edccd9245ac8b516f0e9db1bc36, State: Running, Role: LEADER
I20260808 08:50:28.238289 31315 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } }
I20260808 08:50:28.238948 31308 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:28.241058 31322 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0dc2edccd9245ac8b516f0e9db1bc36. Latest consensus state: current_term: 1 leader_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } } }
I20260808 08:50:28.241149 31320 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0dc2edccd9245ac8b516f0e9db1bc36" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38019 } } }
I20260808 08:50:28.241442 31322 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:28.241528 31320 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:28.242995 31327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:28.248428 31327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:28.256325 31327 catalog_manager.cc:1347] Generated new cluster ID: 0ab6811f6a954aa9852dbde6ff4fee17
I20260808 08:50:28.256425 31327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:28.280503 31327 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:50:28.282357 31327 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:28.289942 31327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0dc2edccd9245ac8b516f0e9db1bc36: Generated new TSK 0
I20260808 08:50:28.290899 31327 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:50:28.351024 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 31194
I20260808 08:50:28.352227 31301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:28.446974 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 31194
2026-08-08T08:50:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2194 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:50:28 dist-test-slave-7vjv krb5kdc[31356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:50:28 dist-test-slave-7vjv krb5kdc[31356](info): set up 2 sockets
Aug 08 08:50:28 dist-test-slave-7vjv krb5kdc[31356](info): commencing operation
krb5kdc: starting...
W20260808 08:50:29.742632 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:50:29 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:50:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:50:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:50:29.976770 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:30.300298 31373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:30.300544 31373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:30.300679 31373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:30.307459 31373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:30.307576 31373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:30.307686 31373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:30.307777 31373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:30.307842 31373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:30.317781 31373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:30.319001 31373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:30.320382 31373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:30.333256 31379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:30.333230 31380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:30.333214 31385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:30.333946 31373 server_base.cc:1034] running on GCE node
I20260808 08:50:30.334638 31373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:30.336288 31373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:30.337565 31373 hybrid_clock.cc:648] HybridClock initialized: now 1786179030337502 us; error 40 us; skew 500 ppm
I20260808 08:50:30.338034 31373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:30 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179030, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:30.346115 31373 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:30.347594 31373 webserver.cc:460] Webserver started at http://127.8.149.126:41547/ using document root <none> and password file <none>
I20260808 08:50:30.348382 31373 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:30.348495 31373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:30.348757 31373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:30.351727 31373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "661f673a84e24fe19095fcd3419df995"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "ed9cb27a7dda2ed56d0cc62cd3eb0019"
server_key_iv: "2c41f7ce8f154d4ae8243545059b255f"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.352566 31373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "661f673a84e24fe19095fcd3419df995"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "ed9cb27a7dda2ed56d0cc62cd3eb0019"
server_key_iv: "2c41f7ce8f154d4ae8243545059b255f"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.357887 31373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:50:30.361389 31395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:30.362680 31373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:30.362824 31373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "661f673a84e24fe19095fcd3419df995"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "ed9cb27a7dda2ed56d0cc62cd3eb0019"
server_key_iv: "2c41f7ce8f154d4ae8243545059b255f"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.363018 31373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:30.383863 31373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:30.387261 31373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:30.387499 31373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:30.406335 31373 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39383
I20260808 08:50:30.406431 31484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39383 every 8 connection(s)
I20260808 08:50:30.407608 31373 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:30.411212 31485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:30.411785 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 31373
I20260808 08:50:30.411994 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:50:30.412635 8789 external_mini_cluster.cc:1428] Setting key c7b6985057f004ff4726ec06f9c12a33
I20260808 08:50:30.425561 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap starting.
Aug 08 08:50:30 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:30.429411 31485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:30.430505 31485 log.cc:824] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:30.433509 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: No bootstrap required, opened a new log
I20260808 08:50:30.436303 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:30.414629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40112 (local address 127.8.149.126:39383)
0808 08:50:30.415425 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:30.415438 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:30.415477 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:50:30.417317 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:30.417337 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:30.417686 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:30.417983 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:30.419954 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:30.421253 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:30.423330 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:30.423947 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:30.424068 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:30.429179 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:30.429186 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:30.429198 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:30.429233 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:30.432220 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:30.432900 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:30.432914 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:30.432919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:30.433079 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:30.433462 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:30.433467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:30.433472 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:30.434045 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:30.434353 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:30.434841 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 08:50:30.435283 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":396,"threads_started":1}
I20260808 08:50:30.442293 31485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:30.442839 31485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:30.442972 31485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Initialized, Role: FOLLOWER
I20260808 08:50:30.443539 31485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:30.443843 31485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:30.444031 31485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:30.444258 31485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:30.446841 31485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:30.447317 31485 leader_election.cc:302] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 661f673a84e24fe19095fcd3419df995; no voters:
I20260808 08:50:30.447947 31485 leader_election.cc:288] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:50:30.448047 31491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:30.449038 31491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 LEADER]: Becoming Leader. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Running, Role: LEADER
I20260808 08:50:30.449612 31491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:30.450364 31485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:30.452682 31498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661f673a84e24fe19095fcd3419df995. Latest consensus state: current_term: 1 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:30.452896 31494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:30.453498 31498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:30.454273 31494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:30.455467 31508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:30.460976 31508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:30.470300 31508 catalog_manager.cc:1347] Generated new cluster ID: 9375dadf294c4c3f8646a7c5f6536601
I20260808 08:50:30.470444 31508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:30.502171 31508 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:50:30.503628 31508 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:30.510466 31508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Generated new TSK 0
I20260808 08:50:30.511281 31508 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:50:30.587129 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:30.911343 31526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:30.911592 31526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:30.911746 31526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:30.918219 31526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:30.918329 31526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:30.918506 31526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:30.926929 31526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:30.928045 31526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:30.929337 31526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:30.942011 31534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:30.942077 31533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:30.942224 31536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:30.943149 31526 server_base.cc:1034] running on GCE node
I20260808 08:50:30.943655 31526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:30.944581 31526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:30.945796 31526 hybrid_clock.cc:648] HybridClock initialized: now 1786179030945759 us; error 30 us; skew 500 ppm
I20260808 08:50:30.946151 31526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:30 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179030, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:30.949247 31526 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:30.950717 31526 webserver.cc:460] Webserver started at http://127.8.149.65:46651/ using document root <none> and password file <none>
I20260808 08:50:30.951476 31526 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:30.951622 31526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:30.951929 31526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:30.954806 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "addb68ea9720480f852de15b762747a1"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "02850ae6957f159b19784db1c2a01efc"
server_key_iv: "75670cff532e22c0889799dce875b507"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.955689 31526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "addb68ea9720480f852de15b762747a1"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "02850ae6957f159b19784db1c2a01efc"
server_key_iv: "75670cff532e22c0889799dce875b507"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.960909 31526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:50:30.964514 31548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:30.965937 31526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:30.966132 31526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "addb68ea9720480f852de15b762747a1"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "02850ae6957f159b19784db1c2a01efc"
server_key_iv: "75670cff532e22c0889799dce875b507"
server_key_version: "encryptionkey@0"
I20260808 08:50:30.966354 31526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:30.992938 31526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:30.996454 31526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:30.996726 31526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:30.997598 31526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:30.998988 31526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:30.999096 31526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:30.999253 31526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:30.999329 31526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:31.033290 31526 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34057
I20260808 08:50:31.033342 31729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34057 every 8 connection(s)
I20260808 08:50:31.034446 31526 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:31.042169 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 31526
I20260808 08:50:31.042392 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:50:31.043114 8789 external_mini_cluster.cc:1428] Setting key 28af20ccbf553fb13352679be88a34d6
Aug 08 08:50:31 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179030, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:31.053550 31733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:31.036896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:60675 (local address 127.8.149.126:39383)
0808 08:50:31.037344 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:31.037348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:31.038253 (+ 905us) server_negotiation.cc:407] Connection header received
0808 08:50:31.039955 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:31.039960 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:31.040039 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:31.040187 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:31.041612 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.042411 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.044086 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.044508 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.044659 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:31.048003 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:31.048008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:31.048011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:31.048042 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:31.050656 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:31.051355 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:31.051360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:31.051363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:31.051520 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:31.051941 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:31.051946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:31.051949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:31.052257 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:31.052395 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:31.053007 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 08:50:31.053218 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":223,"threads_started":1}
I20260808 08:50:31.054366 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:31.037433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:60675)
0808 08:50:31.038117 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:31.038151 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:31.039698 (+ 1547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:31.040413 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:31.040420 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:31.040862 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:31.041440 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:31.041459 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.042570 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.042575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:31.043922 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:31.043935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.044755 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.044764 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:31.045013 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:31.045660 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:31.045681 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:31.047779 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:31.050835 (+ 3056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:31.050843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:31.050855 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:31.051231 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:31.051629 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:31.051634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:31.051637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:31.051816 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:31.052393 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:31.052401 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:31.052675 (+ 274us) client_negotiation.cc:769] Sending connection context
0808 08:50:31.052915 (+ 240us) client_negotiation.cc:240] Negotiation successful
0808 08:50:31.053358 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":278,"threads_started":1}
I20260808 08:50:31.055892 31731 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:31.056248 31731 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:31.056963 31731 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:31.059098 31427 ts_manager.cc:194] Registered new tserver with Master: addb68ea9720480f852de15b762747a1 (127.8.149.65:34057)
I20260808 08:50:31.061218 31427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:60675
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:50:31.103263 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:31.419337 31738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:31.419564 31738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:31.419688 31738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:31.426257 31738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:31.426344 31738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:31.426448 31738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:31.435096 31738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:31.436041 31738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:31.437233 31738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:31.450500 31745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:31.450443 31746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:31.450443 31749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:31.451367 31738 server_base.cc:1034] running on GCE node
I20260808 08:50:31.452011 31738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:31.452867 31738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:31.454070 31738 hybrid_clock.cc:648] HybridClock initialized: now 1786179031454035 us; error 25 us; skew 500 ppm
I20260808 08:50:31.454370 31738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:31 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179031, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:31.457700 31738 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:31.459091 31738 webserver.cc:460] Webserver started at http://127.8.149.66:43909/ using document root <none> and password file <none>
I20260808 08:50:31.459791 31738 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:31.459934 31738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:31.460421 31738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:31.463570 31738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "2aca2e6be3db40df93ba18d202001ded"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "07e4ad42985d5346cb824777d2077f58"
server_key_iv: "94c3b01cd4deb747e6e837c546c95053"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.464558 31738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "2aca2e6be3db40df93ba18d202001ded"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "07e4ad42985d5346cb824777d2077f58"
server_key_iv: "94c3b01cd4deb747e6e837c546c95053"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.469923 31738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:50:31.473307 31759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:31.474548 31738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:50:31.474730 31738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "2aca2e6be3db40df93ba18d202001ded"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "07e4ad42985d5346cb824777d2077f58"
server_key_iv: "94c3b01cd4deb747e6e837c546c95053"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.474929 31738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:31.489781 31738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:31.493350 31738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:31.493624 31738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:31.494505 31738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:31.495671 31738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:31.495770 31738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:31.495945 31738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:31.496034 31738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:31.529503 31738 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:38485
I20260808 08:50:31.529605 31960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:38485 every 8 connection(s)
I20260808 08:50:31.530748 31738 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:31.535064 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 31738
I20260808 08:50:31.535316 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:50:31.535797 8789 external_mini_cluster.cc:1428] Setting key 2dce8768b277796ce1a86d5df82d5572
Aug 08 08:50:31 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179031, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:31.551465 31733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:31.533226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:41501 (local address 127.8.149.126:39383)
0808 08:50:31.533407 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:31.533411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:31.534454 (+ 1043us) server_negotiation.cc:407] Connection header received
0808 08:50:31.536583 (+ 2129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:31.536588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:31.536679 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:31.536792 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:31.538377 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.539449 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.540998 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.541643 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.541783 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:31.545294 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:31.545298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:31.545301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:31.545331 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:31.547872 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:31.548844 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:31.548848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:31.548850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:31.549028 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:31.549542 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:31.549557 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:31.549562 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:31.549951 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:31.550130 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:31.550770 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 08:50:31.551020 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:50:31.552130 31964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:31.533659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:41501)
0808 08:50:31.534305 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:31.534345 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:31.536292 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:31.537075 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:31.537087 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:31.537618 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:31.538217 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:31.538233 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.539594 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.539597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:31.540863 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:31.540875 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:31.541835 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:31.541840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:31.542013 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:31.542629 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:31.542649 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:31.545074 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:31.548032 (+ 2958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:31.548043 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:31.548059 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:31.548715 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:31.549146 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:31.549154 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:31.549160 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:31.549412 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:31.550107 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:31.550112 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:31.550413 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 08:50:31.550613 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 08:50:31.550975 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":260,"threads_started":1}
I20260808 08:50:31.553457 31961 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:31.553772 31961 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:31.554526 31961 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:31.556196 31427 ts_manager.cc:194] Registered new tserver with Master: 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485)
I20260808 08:50:31.557003 31427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:41501
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:50:31.596673 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:31.922514 31967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:31.922914 31967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:31.923085 31967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:31.932289 31967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:31.932431 31967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:31.932600 31967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:31.942028 31967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:31.943209 31967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:31.944540 31967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:31.957604 31982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:31.957634 31986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:31.957551 31984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:31.958717 31967 server_base.cc:1034] running on GCE node
I20260808 08:50:31.959273 31967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:31.960302 31967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:31.961556 31967 hybrid_clock.cc:648] HybridClock initialized: now 1786179031961476 us; error 77 us; skew 500 ppm
I20260808 08:50:31.961854 31967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:31 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179031, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:31.964885 31967 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:31.966303 31967 webserver.cc:460] Webserver started at http://127.8.149.67:40437/ using document root <none> and password file <none>
I20260808 08:50:31.967070 31967 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:31.967208 31967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:31.967583 31967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:31.970616 31967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "e531859e6f7b4352bcecc3b9e4724a6f"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "06830f0f34de4cdad38d17371f379d03"
server_key_iv: "3a6440e18f288c25ec7e2329a9d6b36d"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.971436 31967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "e531859e6f7b4352bcecc3b9e4724a6f"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "06830f0f34de4cdad38d17371f379d03"
server_key_iv: "3a6440e18f288c25ec7e2329a9d6b36d"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.976909 31967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 08:50:31.980716 31997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:31.981990 31967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:31.982152 31967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "e531859e6f7b4352bcecc3b9e4724a6f"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "06830f0f34de4cdad38d17371f379d03"
server_key_iv: "3a6440e18f288c25ec7e2329a9d6b36d"
server_key_version: "encryptionkey@0"
I20260808 08:50:31.982357 31967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:32.015475 31967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:32.019104 31967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:32.019382 31967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:32.020325 31967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:32.021546 31967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:32.021646 31967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:32.021797 31967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:32.021869 31967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:32.056231 31967 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44607
I20260808 08:50:32.056262 32177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44607 every 8 connection(s)
I20260808 08:50:32.057497 31967 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:32.058876 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 31967
I20260808 08:50:32.059070 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:50:32.059513 8789 external_mini_cluster.cc:1428] Setting key 2ca925251ef466f0f9a73d1d351db729
I20260808 08:50:32.063879 31731 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
Aug 08 08:50:32 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179031, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:32.076869 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.060072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:58735 (local address 127.8.149.126:39383)
0808 08:50:32.060594 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.060600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.061696 (+ 1096us) server_negotiation.cc:407] Connection header received
0808 08:50:32.063450 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.063453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.063519 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.063626 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:32.065204 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.066071 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.067626 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.068000 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.068138 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.071283 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:32.071287 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:32.071290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:32.071316 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:32.074065 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.074903 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.074907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.074909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.075031 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.075417 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.075420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.075422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.075675 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:32.075788 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.076445 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.076590 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":238,"threads_started":1}
I20260808 08:50:32.077733 32187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.060661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:58735)
0808 08:50:32.061536 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.061588 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.063207 (+ 1619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.063885 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.063898 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.064522 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:32.065019 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.065053 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.066260 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.066264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.067473 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.067485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.068233 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.068240 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.068445 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.069061 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:32.069085 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:32.071109 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:32.074197 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:32.074205 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:32.074219 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:32.074776 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:32.075128 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:32.075131 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:32.075133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:32.075302 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:32.075781 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:32.075787 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:32.076054 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.076331 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.076655 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":384,"threads_started":1}
I20260808 08:50:32.078966 32179 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:32.079262 32179 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:32.079967 32179 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:32.081233 31427 ts_manager.cc:194] Registered new tserver with Master: e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67:44607)
I20260808 08:50:32.081960 31427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:58735
I20260808 08:50:32.086895 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:50:32.102365 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.091197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40118 (local address 127.8.149.126:39383)
0808 08:50:32.091400 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.091405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.091712 (+ 307us) server_negotiation.cc:407] Connection header received
0808 08:50:32.091837 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.091841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.091893 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.091982 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:32.093373 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.093983 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.095218 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.095555 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.095651 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.097962 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:32.097967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:32.097969 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:32.097995 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:32.100190 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.100790 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.100794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.100796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.100894 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.101246 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.101249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.101251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.101511 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:32.101671 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.101917 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.102074 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:50:32.105782 31427 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:50:32.112066 31427 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:50:32.134701 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.123512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38485 (local address 127.0.0.1:48256)
0808 08:50:32.125032 (+ 1520us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.125047 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.125147 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.126459 (+ 1312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.126484 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.126510 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:32.126969 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.126982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.129088 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.129093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.131537 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.131551 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.133796 (+ 2245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.133804 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.133976 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.134023 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.134118 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.134280 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1407,"mutex_wait_us":62,"thread_start_us":838,"threads_started":1}
I20260808 08:50:32.136382 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.124056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.8.149.66:38485)
0808 08:50:32.125829 (+ 1773us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.125837 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.125864 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:50:32.125971 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.125980 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.126218 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.127183 (+ 965us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:32.127417 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.128932 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.131739 (+ 2807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.133589 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.135601 (+ 2012us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.135792 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.135866 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.136028 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1600,"thread_start_us":1933,"threads_started":1}
I20260808 08:50:32.136736 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.123473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48280 (local address 127.8.149.67:44607)
0808 08:50:32.124169 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.124177 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.124891 (+ 714us) server_negotiation.cc:407] Connection header received
0808 08:50:32.126346 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.126354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.126569 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.126736 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:32.127783 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.130311 (+ 2528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.133744 (+ 3433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.135029 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.135116 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.135334 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.136229 (+ 895us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.136371 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":363,"threads_started":1}
I20260808 08:50:32.137326 32205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.123413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:44607 (local address 127.0.0.1:48280)
0808 08:50:32.124680 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.124751 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.125052 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.127107 (+ 2055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.127114 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.127141 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:32.127574 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.127587 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.130485 (+ 2898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.130490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.133578 (+ 3088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.133590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.135515 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.135523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.135704 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.135733 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.136822 (+ 1089us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.136959 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1050,"mutex_wait_us":1,"thread_start_us":1310,"threads_started":1}
I20260808 08:50:32.139685 31846 tablet_service.cc:1467] Processing CreateTablet for tablet b8dea64b148b4030859cf44a465950ca (DEFAULT_TABLE table=test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:32.140144 32072 tablet_service.cc:1467] Processing CreateTablet for tablet b8dea64b148b4030859cf44a465950ca (DEFAULT_TABLE table=test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:32.141021 31846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dea64b148b4030859cf44a465950ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:32.141523 32072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dea64b148b4030859cf44a465950ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:32.144924 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.125246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34057 (local address 127.0.0.1:32780)
0808 08:50:32.134892 (+ 9646us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.134909 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.134998 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.136318 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.136322 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.136342 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:32.136523 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.136551 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.140605 (+ 4054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.140611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.142221 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.142237 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.144157 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.144163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.144340 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.144371 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.144483 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.144610 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9564,"thread_start_us":10629,"threads_started":1}
I20260808 08:50:32.145051 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.125796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32780 (local address 127.8.149.65:34057)
0808 08:50:32.135701 (+ 9905us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.135710 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.135744 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:50:32.135840 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.135846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.136083 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.136723 (+ 640us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:32.136959 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.140438 (+ 3479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.142405 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.143951 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.144117 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.144347 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.144534 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.144746 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9708,"thread_start_us":9567,"threads_started":1}
I20260808 08:50:32.148782 31622 tablet_service.cc:1467] Processing CreateTablet for tablet b8dea64b148b4030859cf44a465950ca (DEFAULT_TABLE table=test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:32.150197 31622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8dea64b148b4030859cf44a465950ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:32.155458 32210 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Bootstrap starting.
I20260808 08:50:32.157258 32209 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Bootstrap starting.
I20260808 08:50:32.159209 32210 tablet_bootstrap.cc:654] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:32.160244 32210 log.cc:824] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:32.160708 32209 tablet_bootstrap.cc:654] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:32.161909 32209 log.cc:824] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:32.162962 32210 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: No bootstrap required, opened a new log
I20260808 08:50:32.163267 32210 ts_tablet_manager.cc:1397] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 08:50:32.164916 32213 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Bootstrap starting.
I20260808 08:50:32.165880 32209 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: No bootstrap required, opened a new log
I20260808 08:50:32.166209 32209 ts_tablet_manager.cc:1397] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:50:32.168412 32213 tablet_bootstrap.cc:654] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:32.169566 32213 log.cc:824] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:32.172538 32213 tablet_bootstrap.cc:492] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: No bootstrap required, opened a new log
I20260808 08:50:32.172969 32213 ts_tablet_manager.cc:1397] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260808 08:50:32.173417 32210 raft_consensus.cc:348] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.173846 32210 raft_consensus.cc:374] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:32.173970 32210 raft_consensus.cc:729] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca2e6be3db40df93ba18d202001ded, State: Initialized, Role: FOLLOWER
I20260808 08:50:32.174028 32209 raft_consensus.cc:348] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.174520 32209 raft_consensus.cc:374] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:32.174651 32209 raft_consensus.cc:729] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e531859e6f7b4352bcecc3b9e4724a6f, State: Initialized, Role: FOLLOWER
I20260808 08:50:32.174624 32210 consensus_queue.cc:260] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.175390 32209 consensus_queue.cc:260] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.175801 31961 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
I20260808 08:50:32.176523 32210 ts_tablet_manager.cc:1428] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 08:50:32.177448 32179 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
I20260808 08:50:32.177901 32209 ts_tablet_manager.cc:1428] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260808 08:50:32.183588 32213 raft_consensus.cc:348] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.183876 32213 raft_consensus.cc:374] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:32.183998 32213 raft_consensus.cc:729] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: addb68ea9720480f852de15b762747a1, State: Initialized, Role: FOLLOWER
I20260808 08:50:32.184489 32213 consensus_queue.cc:260] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.186026 32213 ts_tablet_manager.cc:1428] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260808 08:50:32.274005 32219 raft_consensus.cc:482] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:50:32.274328 32219 raft_consensus.cc:504] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.276079 32219 leader_election.cc:288] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485), addb68ea9720480f852de15b762747a1 (127.8.149.65:34057)
I20260808 08:50:32.281682 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.276383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:32915 (local address 127.8.149.66:38485)
0808 08:50:32.276600 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.276606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.276627 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:50:32.276844 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.276849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.276908 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.277017 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:32.277416 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.278315 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.279997 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.280824 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.280990 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.281066 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.281314 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.281445 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:50:32.281682 32187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.276256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38485 (local address 127.8.149.67:32915)
0808 08:50:32.276489 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.276510 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.276636 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.277041 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.277050 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.277077 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:32.277276 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.277285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.278456 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.278461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.279846 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.279857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.280974 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.280980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.281164 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.281187 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.281286 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.281410 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:50:32.282661 32222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.276587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34057 (local address 127.8.149.67:56837)
0808 08:50:32.277513 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:32.277526 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:32.277657 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:32.278063 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:32.278067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:32.278090 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:32.278389 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.278403 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.279489 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.279497 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.280855 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:32.280866 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.282003 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.282012 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:32.282173 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.282201 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:50:32.282269 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 08:50:32.282344 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":819,"thread_start_us":612,"threads_started":1}
I20260808 08:50:32.282698 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.276734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:56837 (local address 127.8.149.65:34057)
0808 08:50:32.276974 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.276983 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.277611 (+ 628us) server_negotiation.cc:407] Connection header received
0808 08:50:32.277815 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.277821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.277908 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.277998 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:32.278549 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.279347 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.281012 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.281786 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.281948 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.282005 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.282332 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.282468 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 08:50:32.282747 31962 tablet.cc:2369] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:32.282678 31879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dea64b148b4030859cf44a465950ca" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca2e6be3db40df93ba18d202001ded" is_pre_election: true
I20260808 08:50:32.283300 31879 raft_consensus.cc:2454] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 0.
I20260808 08:50:32.284008 32000 leader_election.cc:302] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca2e6be3db40df93ba18d202001ded, e531859e6f7b4352bcecc3b9e4724a6f; no voters:
I20260808 08:50:32.283937 31647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dea64b148b4030859cf44a465950ca" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "addb68ea9720480f852de15b762747a1" is_pre_election: true
I20260808 08:50:32.284462 32219 raft_consensus.cc:2781] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:50:32.284615 32219 raft_consensus.cc:482] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:50:32.284551 31647 raft_consensus.cc:2454] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 0.
I20260808 08:50:32.284722 32219 raft_consensus.cc:3037] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Advancing to term 1
W20260808 08:50:32.286795 31732 tablet.cc:2369] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:32.287250 32219 raft_consensus.cc:504] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.287820 32219 leader_election.cc:288] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 election: Requested vote from peers 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485), addb68ea9720480f852de15b762747a1 (127.8.149.65:34057)
I20260808 08:50:32.288305 31647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dea64b148b4030859cf44a465950ca" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "addb68ea9720480f852de15b762747a1"
I20260808 08:50:32.288519 31647 raft_consensus.cc:3037] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:32.288563 31879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8dea64b148b4030859cf44a465950ca" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca2e6be3db40df93ba18d202001ded"
I20260808 08:50:32.288728 31879 raft_consensus.cc:3037] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:32.291515 31647 raft_consensus.cc:2454] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 1.
I20260808 08:50:32.291694 31879 raft_consensus.cc:2454] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 1.
I20260808 08:50:32.292078 32003 leader_election.cc:302] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: addb68ea9720480f852de15b762747a1, e531859e6f7b4352bcecc3b9e4724a6f; no voters:
I20260808 08:50:32.292517 32219 raft_consensus.cc:2781] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:32.293005 32219 raft_consensus.cc:686] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 1 LEADER]: Becoming Leader. State: Replica: e531859e6f7b4352bcecc3b9e4724a6f, State: Running, Role: LEADER
I20260808 08:50:32.293437 32219 consensus_queue.cc:237] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } }
I20260808 08:50:32.297613 31427 catalog_manager.cc:5495] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f reported cstate change: term changed from 0 to 1, leader changed from <none> to e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67). New cstate: current_term: 1 leader_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } health_report { overall_health: UNKNOWN } } }
W20260808 08:50:32.309120 32182 tablet.cc:2369] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:32.323285 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.318143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48296 (local address 127.8.149.67:44607)
0808 08:50:32.318327 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.318333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.318445 (+ 112us) server_negotiation.cc:407] Connection header received
0808 08:50:32.318657 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.318660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.318724 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.318859 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:50:32.319213 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.319962 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.321357 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.321723 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.321848 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.322331 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:50:32.322748 (+ 417us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:50:32.322918 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.322967 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.323033 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:50:32.331019 31647 raft_consensus.cc:1261] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Refusing update from remote peer e531859e6f7b4352bcecc3b9e4724a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:32.331240 31879 raft_consensus.cc:1261] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Refusing update from remote peer e531859e6f7b4352bcecc3b9e4724a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:32.332151 32223 consensus_queue.cc:1035] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:32.332458 32219 consensus_queue.cc:1035] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:32.348037 32227 mvcc.cc:205] Tried to move back new op lower bound from 7316189316418260992 to 7316189316277080064. Current Snapshot: MvccSnapshot[applied={T|T < 7316189316418260992}]
I20260808 08:50:32.351217 32228 mvcc.cc:205] Tried to move back new op lower bound from 7316189316418260992 to 7316189316277080064. Current Snapshot: MvccSnapshot[applied={T|T < 7316189316418260992 or (T in {7316189316418260992})}]
I20260808 08:50:32.364323 31427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:32.364581 31427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:32.368669 31427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Sending DeleteTablet for 3 replicas of tablet b8dea64b148b4030859cf44a465950ca
I20260808 08:50:32.369879 32072 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dea64b148b4030859cf44a465950ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:32 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:48280
I20260808 08:50:32.369881 31622 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dea64b148b4030859cf44a465950ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:32 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:32780
I20260808 08:50:32.370600 31846 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dea64b148b4030859cf44a465950ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:32 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:48256
I20260808 08:50:32.370738 32242 tablet_replica.cc:330] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: stopping tablet replica
I20260808 08:50:32.371434 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 31526
I20260808 08:50:32.372869 31620 tablet_service.cc:1514] Processing DeleteTablet for tablet b8dea64b148b4030859cf44a465950ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:32 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:32780
I20260808 08:50:32.371289 32242 raft_consensus.cc:2229] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:32.373144 32241 tablet_replica.cc:330] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: stopping tablet replica
I20260808 08:50:32.373522 32242 raft_consensus.cc:2258] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:32.375768 32242 ts_tablet_manager.cc:1905] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:32.376431 32241 raft_consensus.cc:2229] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:50:32.377458 32241 raft_consensus.cc:2258] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:32.380824 32241 ts_tablet_manager.cc:1905] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:32.382928 32244 tablet_replica.cc:330] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: stopping tablet replica
I20260808 08:50:32.383278 32244 raft_consensus.cc:2229] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:32.383773 32244 raft_consensus.cc:2258] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:32.385325 32242 ts_tablet_manager.cc:1918] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:32.385545 32242 log.cc:1196] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/b8dea64b148b4030859cf44a465950ca
I20260808 08:50:32.385771 32244 ts_tablet_manager.cc:1905] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:32.386096 32242 ts_tablet_manager.cc:1939] T b8dea64b148b4030859cf44a465950ca P addb68ea9720480f852de15b762747a1: Deleting consensus metadata
I20260808 08:50:32.387648 32241 ts_tablet_manager.cc:1918] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:32.387813 32241 log.cc:1196] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/b8dea64b148b4030859cf44a465950ca
I20260808 08:50:32.388247 31404 catalog_manager.cc:4841] TS addb68ea9720480f852de15b762747a1 (127.8.149.65:34057): tablet b8dea64b148b4030859cf44a465950ca (table test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]) successfully deleted
W20260808 08:50:32.389171 31404 catalog_manager.cc:4808] TS addb68ea9720480f852de15b762747a1 (127.8.149.65:34057): delete failed for tablet b8dea64b148b4030859cf44a465950ca because the tablet was not found. No further retry: Not found: Tablet not found: b8dea64b148b4030859cf44a465950ca
Aug 08 08:50:32 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:50:32.392198 32244 ts_tablet_manager.cc:1918] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:32.392369 32244 log.cc:1196] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/b8dea64b148b4030859cf44a465950ca
I20260808 08:50:32.392800 32244 ts_tablet_manager.cc:1939] T b8dea64b148b4030859cf44a465950ca P 2aca2e6be3db40df93ba18d202001ded: Deleting consensus metadata
I20260808 08:50:32.394338 31396 catalog_manager.cc:4841] TS 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485): tablet b8dea64b148b4030859cf44a465950ca (table test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]) successfully deleted
I20260808 08:50:32.396512 32241 ts_tablet_manager.cc:1939] T b8dea64b148b4030859cf44a465950ca P e531859e6f7b4352bcecc3b9e4724a6f: Deleting consensus metadata
I20260808 08:50:32.398000 31404 catalog_manager.cc:4841] TS e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67:44607): tablet b8dea64b148b4030859cf44a465950ca (table test-table [id=bc8a38831f4e4deba3d3dc91f94a5132]) successfully deleted
I20260808 08:50:32.399329 32208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.372506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32782 (local address 127.8.149.65:34057)
0808 08:50:32.372706 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.372714 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.378645 (+ 5931us) server_negotiation.cc:407] Connection header received
0808 08:50:32.378857 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.378863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.378946 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.379052 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:32.381359 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.382498 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.384759 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.385458 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.385585 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.392271 (+ 6686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:32.392285 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:32.392301 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:32.392341 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:32.396271 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.397159 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.397168 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.397171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.397339 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.398003 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.398007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.398009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.398392 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:32.398615 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.398947 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.399099 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":59}
I20260808 08:50:32.400015 31723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:32.483598 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 31526
I20260808 08:50:32.510874 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 31738
Aug 08 08:50:32 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:50:32.532954 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.511726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.8.149.66:38485)
0808 08:50:32.511898 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.511902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.511953 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:50:32.512225 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.512230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.512305 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.512388 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:32.514040 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.514733 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.516733 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.517104 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.517208 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.526491 (+ 9283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:32.526505 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:32.526520 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:32.526550 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:32.529717 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.530502 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.530511 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.530514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.530659 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.531061 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.531065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.531068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.531571 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:32.531843 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.532193 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.532431 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:50:32.533650 31951 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:32.625856 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 31738
I20260808 08:50:32.651197 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 31967
Aug 08 08:50:32 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:50:32.669422 32203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:32.652325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.8.149.67:44607)
0808 08:50:32.652546 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:32.652553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:32.652577 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:50:32.652644 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:32.652652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:32.652759 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:32.652886 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:32.654139 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.655491 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.657145 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:32.657861 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:32.658017 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:32.662504 (+ 4487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:32.662516 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:32.662533 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:32.662574 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:32.666429 (+ 3855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.667180 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.667195 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.667200 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.667403 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:32.667780 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:32.667785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:32.667788 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:32.668268 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:32.668635 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:32.668792 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 08:50:32.669037 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:50:32.670293 32172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:32.786602 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 31967
I20260808 08:50:32.812377 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 31373
I20260808 08:50:32.813540 31475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:32.916711 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 31373
I20260808 08:50:32.946277 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--webserver_interface=127.8.149.126
--webserver_port=41547
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:33.265432 32254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:33.265686 32254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:33.265879 32254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:33.272486 32254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:33.272571 32254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:33.272663 32254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:33.272753 32254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:33.272840 32254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:33.282089 32254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=41547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:33.283375 32254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:33.284680 32254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:33.309203 32270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:33.309193 32261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:33.309290 32262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:33.310127 32254 server_base.cc:1034] running on GCE node
I20260808 08:50:33.311003 32254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:33.312544 32254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:33.313779 32254 hybrid_clock.cc:648] HybridClock initialized: now 1786179033313735 us; error 47 us; skew 500 ppm
I20260808 08:50:33.314163 32254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:33 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:33.317658 32254 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:33.319350 32254 webserver.cc:460] Webserver started at http://127.8.149.126:41547/ using document root <none> and password file <none>
I20260808 08:50:33.320071 32254 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:33.320309 32254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:33.325850 32254 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 08:50:33.328737 32286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:33.329942 32254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:33.330124 32254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "661f673a84e24fe19095fcd3419df995"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "ed9cb27a7dda2ed56d0cc62cd3eb0019"
server_key_iv: "2c41f7ce8f154d4ae8243545059b255f"
server_key_version: "encryptionkey@0"
I20260808 08:50:33.331197 32254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:33.360589 32254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:33.364948 32254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:33.365257 32254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:33.386070 32254 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39383
I20260808 08:50:33.386086 32383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39383 every 8 connection(s)
I20260808 08:50:33.387810 32254 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:33.390731 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 32254
I20260808 08:50:33.391667 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:34057
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=46651
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:33.394567 32384 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:50:33.397671 32384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap starting.
I20260808 08:50:33.416000 32384 log.cc:824] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:33.427570 32384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:50:33.428081 32384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap complete.
I20260808 08:50:33.437150 32384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:33.437909 32384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Initialized, Role: FOLLOWER
I20260808 08:50:33.438436 32384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:33.438664 32384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:33.438781 32384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:33.438943 32384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:50:33.442497 32384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:33.442979 32384 leader_election.cc:302] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 661f673a84e24fe19095fcd3419df995; no voters:
I20260808 08:50:33.443627 32384 leader_election.cc:288] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:50:33.443769 32391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:50:33.445168 32391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 LEADER]: Becoming Leader. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Running, Role: LEADER
I20260808 08:50:33.445670 32391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:33.445977 32384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:33.448242 32392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:33.448673 32392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:33.453341 32393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661f673a84e24fe19095fcd3419df995. Latest consensus state: current_term: 2 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:33.453658 32393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:33.456171 32399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:33.465283 32399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:33.466636 32399 catalog_manager.cc:1259] Loaded cluster ID: 9375dadf294c4c3f8646a7c5f6536601
I20260808 08:50:33.466742 32399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:33.469885 32399 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 08:50:33.487334 32399 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 08:50:33.500402 32399 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:33.501974 32399 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Loaded TSK: 0
I20260808 08:50:33.503414 32399 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:50:33.739543 32387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:33.739794 32387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:33.739923 32387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:33.746795 32387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:33.746929 32387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:33.747093 32387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:33.756425 32387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:34057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=46651
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:33.757745 32387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:33.759080 32387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:33.773535 32425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:33.774068 32426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:33.774197 32428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:33.775130 32387 server_base.cc:1034] running on GCE node
I20260808 08:50:33.775772 32387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:33.776806 32387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:33.778048 32387 hybrid_clock.cc:648] HybridClock initialized: now 1786179033777975 us; error 56 us; skew 500 ppm
I20260808 08:50:33.778376 32387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:33 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:33.782100 32387 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:33.783520 32387 webserver.cc:460] Webserver started at http://127.8.149.65:46651/ using document root <none> and password file <none>
I20260808 08:50:33.784232 32387 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:33.784379 32387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:33.789722 32387 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:33.792573 32444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:33.793900 32387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:33.794088 32387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "addb68ea9720480f852de15b762747a1"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "02850ae6957f159b19784db1c2a01efc"
server_key_iv: "75670cff532e22c0889799dce875b507"
server_key_version: "encryptionkey@0"
I20260808 08:50:33.795032 32387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:33.809679 32387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:33.813747 32387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:33.814051 32387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:33.814980 32387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:33.816325 32387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:33.816458 32387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:33.816586 32387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:33.816679 32387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:33.850008 32387 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34057
I20260808 08:50:33.850104 32626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34057 every 8 connection(s)
I20260808 08:50:33.851423 32387 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:33.859632 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 32387
I20260808 08:50:33.860350 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:38485
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=43909
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:50:33 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179033, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:33.874933 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:33.854193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:37597)
0808 08:50:33.854969 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:33.855021 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:33.856735 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:33.858001 (+ 1266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:33.858008 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:33.858454 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:33.858941 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:33.858957 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:33.860736 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:33.860755 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:33.862846 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:33.862864 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:33.863856 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:33.863865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:33.864230 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:33.864936 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:33.864969 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:33.867539 (+ 2570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:33.870760 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:33.870768 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:33.870780 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:33.871179 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:33.871683 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:33.871688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:33.871692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:33.871891 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:33.872674 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:33.872683 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:33.872989 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 08:50:33.873247 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:50:33.873722 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":357,"threads_started":1}
I20260808 08:50:33.874933 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:33.854096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:37597 (local address 127.8.149.126:39383)
0808 08:50:33.854641 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:33.854652 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:33.855143 (+ 491us) server_negotiation.cc:407] Connection header received
0808 08:50:33.857195 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:33.857207 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:33.857579 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:33.857924 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:33.859162 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:33.860533 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:33.862992 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:33.863621 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:33.863748 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:33.867801 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:33.867808 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:33.867820 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:33.867854 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:33.870608 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:33.871318 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:33.871330 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:33.871335 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:33.871558 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:33.872010 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:33.872016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:33.872019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:33.872509 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:33.872748 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:33.873457 (+ 709us) server_negotiation.cc:299] Negotiation successful
0808 08:50:33.873826 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":249,"threads_started":1}
I20260808 08:50:33.877825 32628 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:33.878110 32628 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:33.878773 32628 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:33.881088 32318 ts_manager.cc:194] Registered new tserver with Master: addb68ea9720480f852de15b762747a1 (127.8.149.65:34057)
I20260808 08:50:33.883381 32318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:37597
W20260808 08:50:34.184023 32634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:34.184270 32634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:34.184348 32634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:34.191228 32634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:34.191318 32634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:34.191416 32634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:34.201393 32634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:38485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=43909
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:34.202587 32634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:34.203938 32634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:34.217096 32641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:34.217140 32640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:34.217032 32643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:34.218134 32634 server_base.cc:1034] running on GCE node
I20260808 08:50:34.218719 32634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:34.219733 32634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:34.220974 32634 hybrid_clock.cc:648] HybridClock initialized: now 1786179034220892 us; error 78 us; skew 500 ppm
I20260808 08:50:34.221290 32634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:34 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179034, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:34.224474 32634 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:34.225914 32634 webserver.cc:460] Webserver started at http://127.8.149.66:43909/ using document root <none> and password file <none>
I20260808 08:50:34.226548 32634 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:34.226665 32634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:34.231997 32634 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:34.234704 32658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.236223 32634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:34.236402 32634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "2aca2e6be3db40df93ba18d202001ded"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "07e4ad42985d5346cb824777d2077f58"
server_key_iv: "94c3b01cd4deb747e6e837c546c95053"
server_key_version: "encryptionkey@0"
I20260808 08:50:34.237411 32634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:34.261602 32634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:34.265623 32634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:34.265939 32634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:34.266943 32634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:34.268334 32634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:34.268489 32634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.268633 32634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:34.268728 32634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.302961 32634 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:38485
I20260808 08:50:34.303048 380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:38485 every 8 connection(s)
I20260808 08:50:34.304463 32634 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:34.309335 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 32634
I20260808 08:50:34.309970 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:44607
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=40437
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:50:34 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179034, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:34.325071 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.307159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:35505 (local address 127.8.149.126:39383)
0808 08:50:34.307335 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.307340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.308517 (+ 1177us) server_negotiation.cc:407] Connection header received
0808 08:50:34.310378 (+ 1861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.310394 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.310487 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.310602 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:34.311923 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.312957 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.314410 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.315172 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.315311 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.318705 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:34.318712 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:34.318719 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:34.318762 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:34.321672 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.322685 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.322690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.322692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.322850 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.323386 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.323390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.323392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.323651 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:34.323790 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.324644 (+ 854us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.324812 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:50:34.326490 384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.307587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:35505)
0808 08:50:34.308349 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.308410 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.310049 (+ 1639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.310777 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.310784 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.311233 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:34.311760 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.311776 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.313102 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.313105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.314252 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.314263 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.315369 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.315374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.315567 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.316236 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:34.316272 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:34.318512 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:34.321807 (+ 3295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:34.321817 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:34.321834 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:34.322536 (+ 702us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:34.323010 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:34.323018 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:34.323024 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:34.323261 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:34.323815 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:34.323825 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:34.324268 (+ 443us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.324531 (+ 263us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.325065 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":261,"threads_started":1}
I20260808 08:50:34.327967 382 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:34.328328 382 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:34.329069 382 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:34.330587 32318 ts_manager.cc:194] Registered new tserver with Master: 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485)
I20260808 08:50:34.331498 32318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:35505
W20260808 08:50:34.643442 385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:34.643667 385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:34.643803 385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:34.650378 385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:34.650467 385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:34.650674 385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:34.659518 385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:44607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=40437
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:34.660677 385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:34.661873 385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:34.675027 392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:34.675074 391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:34.674983 394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:34.676267 385 server_base.cc:1034] running on GCE node
I20260808 08:50:34.676821 385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:34.677664 385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:34.678855 385 hybrid_clock.cc:648] HybridClock initialized: now 1786179034678824 us; error 31 us; skew 500 ppm
I20260808 08:50:34.679157 385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:34 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179034, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:34.682190 385 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:34.683631 385 webserver.cc:460] Webserver started at http://127.8.149.67:40437/ using document root <none> and password file <none>
I20260808 08:50:34.684342 385 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:34.684497 385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:34.689416 385 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:50:34.691960 405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.693451 385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:50:34.693625 385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "e531859e6f7b4352bcecc3b9e4724a6f"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "06830f0f34de4cdad38d17371f379d03"
server_key_iv: "3a6440e18f288c25ec7e2329a9d6b36d"
server_key_version: "encryptionkey@0"
I20260808 08:50:34.694550 385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:34.713725 385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:34.717785 385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:34.718039 385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:34.719008 385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:34.720373 385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:34.720499 385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.720635 385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:34.720724 385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:34.755518 385 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44607
I20260808 08:50:34.755576 599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44607 every 8 connection(s)
I20260808 08:50:34.756912 385 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:34.759827 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 385
Aug 08 08:50:34 dist-test-slave-7vjv krb5kdc[31356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179034, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:34.776258 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.760759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40124 (local address 127.8.149.126:39383)
0808 08:50:34.763741 (+ 2982us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.763746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.763762 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:50:34.763812 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.763816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.763895 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.763999 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:34.765442 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.766224 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.767547 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.768030 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.768203 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.770826 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:34.770831 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:34.770834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:34.770860 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:34.773765 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.774402 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.774408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.774411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.774533 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.774884 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.774890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.774893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.775146 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:34.775403 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.775684 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.775905 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2882,"thread_start_us":2751,"threads_started":1}
I20260808 08:50:34.777148 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.759411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:47041 (local address 127.8.149.126:39383)
0808 08:50:34.759639 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.759645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.760908 (+ 1263us) server_negotiation.cc:407] Connection header received
0808 08:50:34.762698 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.762704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.762792 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.763149 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:34.764937 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.765668 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.767145 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.767536 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.767679 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.771121 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:34.771126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:34.771128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:34.771168 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:34.774235 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.774897 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.774902 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.774905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.775051 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.775457 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.775464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.775471 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.775694 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:34.775871 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.776611 (+ 740us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.776833 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:50:34.778229 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.759879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:47041)
0808 08:50:34.760734 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.760785 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.762440 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.763582 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.763595 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.764287 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:34.764773 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.764788 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.765836 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.765844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.766994 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.767007 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.767772 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.767781 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.768149 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.768902 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:34.768938 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:34.770915 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:34.774380 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:34.774388 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:34.774400 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:34.774762 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:34.775158 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:34.775162 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:34.775165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:34.775334 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:34.775818 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:34.775826 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:34.776191 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.776497 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.776951 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":365,"threads_started":1}
I20260808 08:50:34.779549 600 heartbeater.cc:347] Connected to a master server at 127.8.149.126:39383
I20260808 08:50:34.779799 600 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:34.780507 600 heartbeater.cc:511] Master 127.8.149.126:39383 requested a full tablet report, sending...
I20260808 08:50:34.781797 32318 ts_manager.cc:194] Registered new tserver with Master: e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67:44607)
I20260808 08:50:34.782573 32318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:47041
I20260808 08:50:34.791141 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:50:34.797942 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.792042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.8.149.126:39383)
0808 08:50:34.792254 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.792258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.792800 (+ 542us) server_negotiation.cc:407] Connection header received
0808 08:50:34.792984 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.792987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.793095 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.793201 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:50:34.793594 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.794239 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.795988 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.796362 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.796444 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.796940 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:50:34.797324 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:50:34.797414 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.797611 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.797681 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260808 08:50:34.798772 32318 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:50:34.805871 32318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:50:34.830096 617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.816695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:44607 (local address 127.0.0.1:48314)
0808 08:50:34.817404 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.817447 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.817596 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.819139 (+ 1543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.819149 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.819184 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:34.819663 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.819677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.822457 (+ 2780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.822465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.825565 (+ 3100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.825585 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.828422 (+ 2837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.828432 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.828713 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.828787 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.829034 (+ 247us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.829415 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":337,"threads_started":1}
I20260808 08:50:34.831211 618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.817064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48314 (local address 127.8.149.67:44607)
0808 08:50:34.818447 (+ 1383us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.818458 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.818496 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:50:34.818595 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.818605 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.818864 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.819920 (+ 1056us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:34.820262 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.822258 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.825806 (+ 3548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.828127 (+ 2321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.830429 (+ 2302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.830734 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.830814 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.830961 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1225,"thread_start_us":1083,"threads_started":1}
I20260808 08:50:34.834693 487 tablet_service.cc:1467] Processing CreateTablet for tablet c3c31788a3b445199163a726ac2f7974 (DEFAULT_TABLE table=test-table [id=68e507960d1348559d953d3fefceec4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:34.836076 487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c31788a3b445199163a726ac2f7974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:34.837128 620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.817901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34057 (local address 127.0.0.1:32794)
0808 08:50:34.829219 (+ 11318us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.829237 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.829348 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.830275 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.830281 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.830303 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:34.830686 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.830704 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.832491 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.832495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.834474 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.834488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.836369 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.836376 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.836576 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.836608 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.836700 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.836825 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11183,"thread_start_us":11018,"threads_started":1}
I20260808 08:50:34.837210 623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.818524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32794 (local address 127.8.149.65:34057)
0808 08:50:34.828553 (+ 10029us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.828565 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.829477 (+ 912us) server_negotiation.cc:407] Connection header received
0808 08:50:34.829578 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.829585 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.829810 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.830005 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:34.830905 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.832344 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.834655 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.836034 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.836244 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.836455 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.836766 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.836926 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9826,"thread_start_us":10058,"threads_started":1}
I20260808 08:50:34.838689 619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.817468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38485 (local address 127.0.0.1:48274)
0808 08:50:34.819411 (+ 1943us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.819431 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.819580 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.831721 (+ 12141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.831726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.831751 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:34.832079 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.832116 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.834066 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.834071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.836135 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.836152 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.837957 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.837963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.838140 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.838171 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.838268 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.838380 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1767,"thread_start_us":1203,"threads_started":1}
I20260808 08:50:34.838754 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.818259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.8.149.66:38485)
0808 08:50:34.831070 (+ 12811us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.831078 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.831109 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:50:34.831201 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.831208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.831523 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.831704 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:34.832311 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.833884 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.836309 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.837717 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.837859 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.838040 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.838322 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.838482 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12642,"thread_start_us":12535,"threads_started":1}
I20260808 08:50:34.840857 32518 tablet_service.cc:1467] Processing CreateTablet for tablet c3c31788a3b445199163a726ac2f7974 (DEFAULT_TABLE table=test-table [id=68e507960d1348559d953d3fefceec4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:34.842123 32518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c31788a3b445199163a726ac2f7974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:34.842144 32735 tablet_service.cc:1467] Processing CreateTablet for tablet c3c31788a3b445199163a726ac2f7974 (DEFAULT_TABLE table=test-table [id=68e507960d1348559d953d3fefceec4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:34.843393 32735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3c31788a3b445199163a726ac2f7974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:34.848680 625 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Bootstrap starting.
I20260808 08:50:34.852262 625 tablet_bootstrap.cc:654] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:34.853583 625 log.cc:824] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:34.862002 630 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Bootstrap starting.
I20260808 08:50:34.864253 627 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Bootstrap starting.
I20260808 08:50:34.865489 625 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: No bootstrap required, opened a new log
I20260808 08:50:34.865790 625 ts_tablet_manager.cc:1397] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.009s
I20260808 08:50:34.865937 630 tablet_bootstrap.cc:654] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:34.867163 630 log.cc:824] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:34.868271 627 tablet_bootstrap.cc:654] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:34.869441 627 log.cc:824] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:34.870357 630 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: No bootstrap required, opened a new log
I20260808 08:50:34.870656 630 ts_tablet_manager.cc:1397] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:50:34.872232 627 tablet_bootstrap.cc:492] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: No bootstrap required, opened a new log
I20260808 08:50:34.872468 627 ts_tablet_manager.cc:1397] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260808 08:50:34.873911 625 raft_consensus.cc:348] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.874220 625 raft_consensus.cc:374] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:34.874334 625 raft_consensus.cc:729] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e531859e6f7b4352bcecc3b9e4724a6f, State: Initialized, Role: FOLLOWER
I20260808 08:50:34.874886 625 consensus_queue.cc:260] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.875829 600 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
I20260808 08:50:34.876071 635 raft_consensus.cc:482] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:50:34.876495 625 ts_tablet_manager.cc:1428] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260808 08:50:34.876400 635 raft_consensus.cc:504] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.879338 635 leader_election.cc:288] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers addb68ea9720480f852de15b762747a1 (127.8.149.65:34057), 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485)
I20260808 08:50:34.880976 630 raft_consensus.cc:348] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.881389 630 raft_consensus.cc:374] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:34.881485 630 raft_consensus.cc:729] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: addb68ea9720480f852de15b762747a1, State: Initialized, Role: FOLLOWER
I20260808 08:50:34.882122 630 consensus_queue.cc:260] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.883538 627 raft_consensus.cc:348] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.884050 627 raft_consensus.cc:374] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:34.884210 627 raft_consensus.cc:729] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca2e6be3db40df93ba18d202001ded, State: Initialized, Role: FOLLOWER
I20260808 08:50:34.884963 627 consensus_queue.cc:260] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.885958 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.878522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:34057 (local address 127.8.149.67:49541)
0808 08:50:34.878707 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.878727 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.878834 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.879966 (+ 1132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.879970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.880004 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:34.880215 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.880231 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.881584 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.881589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.883456 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.883471 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.885221 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.885227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.885443 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.885559 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.885644 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.885772 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 08:50:34.886404 32628 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
I20260808 08:50:34.887574 623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.879224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:49541 (local address 127.8.149.65:34057)
0808 08:50:34.879693 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.879698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.879717 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:50:34.879774 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.879783 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.879837 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.879952 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:34.880377 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.881420 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.883633 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.884883 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.885054 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.885133 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.886218 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.886342 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323}
I20260808 08:50:34.889340 32558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c31788a3b445199163a726ac2f7974" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "addb68ea9720480f852de15b762747a1" is_pre_election: true
I20260808 08:50:34.889771 32558 raft_consensus.cc:2454] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 0.
I20260808 08:50:34.890431 415 leader_election.cc:302] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: addb68ea9720480f852de15b762747a1, e531859e6f7b4352bcecc3b9e4724a6f; no voters:
I20260808 08:50:34.890789 635 raft_consensus.cc:2781] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:50:34.890964 635 raft_consensus.cc:482] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:50:34.891072 635 raft_consensus.cc:3037] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:34.893430 627 ts_tablet_manager.cc:1428] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Time spent starting tablet: real 0.021s user 0.013s sys 0.006s
I20260808 08:50:34.893803 382 heartbeater.cc:503] Master 127.8.149.126:39383 was elected leader, sending a full tablet report...
I20260808 08:50:34.894238 635 raft_consensus.cc:504] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.894627 630 ts_tablet_manager.cc:1428] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Time spent starting tablet: real 0.024s user 0.012s sys 0.004s
I20260808 08:50:34.895561 32558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c31788a3b445199163a726ac2f7974" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "addb68ea9720480f852de15b762747a1"
I20260808 08:50:34.895763 32558 raft_consensus.cc:3037] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:34.896394 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.880725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:40073 (local address 127.8.149.66:38485)
0808 08:50:34.880891 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.880896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.883075 (+ 2179us) server_negotiation.cc:407] Connection header received
0808 08:50:34.883538 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.883543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.883620 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.883715 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:34.885266 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.887859 (+ 2593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.891645 (+ 3786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.893023 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.893188 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.893262 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.895997 (+ 2735us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.896151 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:50:34.896461 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.880371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38485 (local address 127.8.149.67:40073)
0808 08:50:34.882980 (+ 2609us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:34.882998 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:34.883238 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:34.883956 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:34.883960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:34.883990 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:34.884678 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.884691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.888146 (+ 3455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.888154 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.891457 (+ 3303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:34.891476 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.895567 (+ 4091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.895576 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:34.895791 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.895847 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 08:50:34.895972 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:50:34.896120 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2463,"thread_start_us":2676,"threads_started":1}
I20260808 08:50:34.898038 304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c31788a3b445199163a726ac2f7974" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca2e6be3db40df93ba18d202001ded" is_pre_election: true
I20260808 08:50:34.898561 304 raft_consensus.cc:2454] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 0.
I20260808 08:50:34.899124 32558 raft_consensus.cc:2454] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 1.
I20260808 08:50:34.899600 415 leader_election.cc:302] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: addb68ea9720480f852de15b762747a1, e531859e6f7b4352bcecc3b9e4724a6f; no voters:
I20260808 08:50:34.900346 644 raft_consensus.cc:2781] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:34.900442 304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3c31788a3b445199163a726ac2f7974" candidate_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca2e6be3db40df93ba18d202001ded"
I20260808 08:50:34.900671 304 raft_consensus.cc:3037] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:34.900945 644 raft_consensus.cc:686] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 1 LEADER]: Becoming Leader. State: Replica: e531859e6f7b4352bcecc3b9e4724a6f, State: Running, Role: LEADER
I20260808 08:50:34.901408 644 consensus_queue.cc:237] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } }
I20260808 08:50:34.902921 304 raft_consensus.cc:2454] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e531859e6f7b4352bcecc3b9e4724a6f in term 1.
I20260808 08:50:34.903177 635 leader_election.cc:288] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [CANDIDATE]: Term 1 election: Requested vote from peers addb68ea9720480f852de15b762747a1 (127.8.149.65:34057), 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485)
I20260808 08:50:34.905355 32317 catalog_manager.cc:5495] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f reported cstate change: term changed from 0 to 1, leader changed from <none> to e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67). New cstate: current_term: 1 leader_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e531859e6f7b4352bcecc3b9e4724a6f" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 } health_report { overall_health: UNKNOWN } } }
I20260808 08:50:34.926522 618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.920958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48326 (local address 127.8.149.67:44607)
0808 08:50:34.921167 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.921173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.921281 (+ 108us) server_negotiation.cc:407] Connection header received
0808 08:50:34.921520 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.921524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.921592 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.921738 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:50:34.922109 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.922790 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.924502 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.924919 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.925057 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.925509 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:50:34.925969 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:50:34.926132 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.926188 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.926264 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:50:34.933967 304 raft_consensus.cc:1261] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Refusing update from remote peer e531859e6f7b4352bcecc3b9e4724a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:34.933962 32558 raft_consensus.cc:1261] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Refusing update from remote peer e531859e6f7b4352bcecc3b9e4724a6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:34.934883 644 consensus_queue.cc:1035] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca2e6be3db40df93ba18d202001ded" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:34.935160 635 consensus_queue.cc:1035] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "addb68ea9720480f852de15b762747a1" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 34057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:34.959446 32317 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:34.959728 32317 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:34.963306 32317 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Sending DeleteTablet for 3 replicas of tablet c3c31788a3b445199163a726ac2f7974
I20260808 08:50:34.964591 32518 tablet_service.cc:1514] Processing DeleteTablet for tablet c3c31788a3b445199163a726ac2f7974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:34 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:32794
I20260808 08:50:34.964699 32735 tablet_service.cc:1514] Processing DeleteTablet for tablet c3c31788a3b445199163a726ac2f7974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:34 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:48274
I20260808 08:50:34.965024 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 32387
I20260808 08:50:34.965339 487 tablet_service.cc:1514] Processing DeleteTablet for tablet c3c31788a3b445199163a726ac2f7974 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:34 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:48314
I20260808 08:50:34.965977 666 tablet_replica.cc:330] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: stopping tablet replica
I20260808 08:50:34.966468 666 raft_consensus.cc:2229] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:34.967013 666 raft_consensus.cc:2258] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:34.967859 668 tablet_replica.cc:330] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: stopping tablet replica
I20260808 08:50:34.970789 666 ts_tablet_manager.cc:1905] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:34.978415 667 tablet_replica.cc:330] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: stopping tablet replica
I20260808 08:50:34.978905 667 raft_consensus.cc:2229] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:34.979444 667 raft_consensus.cc:2258] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:34.979743 666 ts_tablet_manager.cc:1918] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:34.979926 666 log.cc:1196] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/c3c31788a3b445199163a726ac2f7974
I20260808 08:50:34.968173 668 raft_consensus.cc:2229] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:50:34.980554 666 ts_tablet_manager.cc:1939] T c3c31788a3b445199163a726ac2f7974 P addb68ea9720480f852de15b762747a1: Deleting consensus metadata
I20260808 08:50:34.980861 668 raft_consensus.cc:2258] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:34.982439 32294 catalog_manager.cc:4841] TS addb68ea9720480f852de15b762747a1 (127.8.149.65:34057): tablet c3c31788a3b445199163a726ac2f7974 (table test-table [id=68e507960d1348559d953d3fefceec4a]) successfully deleted
I20260808 08:50:34.983240 667 ts_tablet_manager.cc:1905] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:34.984359 668 ts_tablet_manager.cc:1905] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:34.984993 623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:34.965951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.8.149.65:34057)
0808 08:50:34.966126 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:34.966133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:34.966242 (+ 109us) server_negotiation.cc:407] Connection header received
0808 08:50:34.966465 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:34.966470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:34.966609 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:34.966717 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:34.968798 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.969628 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.971494 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:34.972276 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:34.972429 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:34.976047 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:34.976086 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:34.976104 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:34.976180 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:34.980746 (+ 4566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.981987 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.981996 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.981999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.982150 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:34.982691 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:34.982696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:34.982699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:34.983195 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:34.983508 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:34.984326 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 08:50:34.984549 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":44}
I20260808 08:50:34.986171 32622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:34.990783 667 ts_tablet_manager.cc:1918] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:34.991000 667 log.cc:1196] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/c3c31788a3b445199163a726ac2f7974
I20260808 08:50:34.991560 667 ts_tablet_manager.cc:1939] T c3c31788a3b445199163a726ac2f7974 P 2aca2e6be3db40df93ba18d202001ded: Deleting consensus metadata
I20260808 08:50:34.991835 668 ts_tablet_manager.cc:1918] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:34.991994 668 log.cc:1196] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/c3c31788a3b445199163a726ac2f7974
I20260808 08:50:34.992584 668 ts_tablet_manager.cc:1939] T c3c31788a3b445199163a726ac2f7974 P e531859e6f7b4352bcecc3b9e4724a6f: Deleting consensus metadata
I20260808 08:50:34.993566 32287 catalog_manager.cc:4841] TS 2aca2e6be3db40df93ba18d202001ded (127.8.149.66:38485): tablet c3c31788a3b445199163a726ac2f7974 (table test-table [id=68e507960d1348559d953d3fefceec4a]) successfully deleted
I20260808 08:50:34.994148 32294 catalog_manager.cc:4841] TS e531859e6f7b4352bcecc3b9e4724a6f (127.8.149.67:44607): tablet c3c31788a3b445199163a726ac2f7974 (table test-table [id=68e507960d1348559d953d3fefceec4a]) successfully deleted
I20260808 08:50:35.079991 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 32387
I20260808 08:50:35.105679 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 32634
I20260808 08:50:35.121268 622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:35.106570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48282 (local address 127.8.149.66:38485)
0808 08:50:35.106752 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:35.106757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:35.106801 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:50:35.107011 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:35.107015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:35.107077 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:35.107161 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:35.109035 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:35.109731 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:35.111741 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:35.112220 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:35.112310 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:35.115524 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:35.115539 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:35.115554 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:35.115597 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:35.118321 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:35.119127 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:35.119133 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:35.119135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:35.119249 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:35.119655 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:35.119658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:35.119660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:35.120033 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:35.120398 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:35.120790 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:50:35.120970 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:50:35.121984 370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:35.206286 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 32634
I20260808 08:50:35.239849 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 385
I20260808 08:50:35.255081 618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:35.240785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48340 (local address 127.8.149.67:44607)
0808 08:50:35.241004 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:35.241008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:35.241029 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:50:35.241219 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:35.241222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:35.241281 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:35.241359 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:35.243236 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:35.244037 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:35.245717 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:35.246271 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:35.246435 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:35.249124 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:35.249136 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:35.249153 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:35.249204 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:35.252173 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:35.252854 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:35.252866 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:35.252870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:35.253039 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:35.253427 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:35.253432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:35.253435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:35.253781 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:35.254110 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:35.254385 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 08:50:35.254615 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 08:50:35.255972 594 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:35.375002 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 385
I20260808 08:50:35.408989 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 32254
I20260808 08:50:35.410192 32373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:35.522737 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 32254
I20260808 08:50:35.551152 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--webserver_interface=127.8.149.126
--webserver_port=41547
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:39383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:35.875357 677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:35.875730 677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:35.875936 677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:35.882866 677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:35.882997 677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:35.883101 677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:35.883208 677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:35.883287 677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:35.892657 677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:39383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=41547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:35.893850 677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:35.895066 677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:35.906625 686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:35.907193 691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:35.907579 693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:35.907701 677 server_base.cc:1034] running on GCE node
I20260808 08:50:35.908587 677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:35.909924 677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:35.911127 677 hybrid_clock.cc:648] HybridClock initialized: now 1786179035911077 us; error 36 us; skew 500 ppm
I20260808 08:50:35.911509 677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:35 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179035, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:35.922035 677 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:35.923547 677 webserver.cc:460] Webserver started at http://127.8.149.126:41547/ using document root <none> and password file <none>
I20260808 08:50:35.924295 677 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:35.924439 677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:35.929651 677 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:35.932430 706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:35.933705 677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:35.933890 677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "661f673a84e24fe19095fcd3419df995"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "ed9cb27a7dda2ed56d0cc62cd3eb0019"
server_key_iv: "2c41f7ce8f154d4ae8243545059b255f"
server_key_version: "encryptionkey@0"
I20260808 08:50:35.934823 677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:35.952442 677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:35.956483 677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:35.956739 677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:35.975893 677 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:39383
I20260808 08:50:35.975939 800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:39383 every 8 connection(s)
I20260808 08:50:35.977290 677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:35.983642 801 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:50:35.986057 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 677
I20260808 08:50:35.987057 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:34057
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=46651
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:35.987239 801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap starting.
I20260808 08:50:36.010552 801 log.cc:824] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:36.026355 801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:50:36.026859 801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995: Bootstrap complete.
I20260808 08:50:36.035396 801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:36.036229 801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Initialized, Role: FOLLOWER
I20260808 08:50:36.036785 801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:36.037029 801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:36.037164 801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:36.037344 801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:50:36.041492 801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:36.041999 801 leader_election.cc:302] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 661f673a84e24fe19095fcd3419df995; no voters:
I20260808 08:50:36.042649 801 leader_election.cc:288] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:50:36.042853 808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:50:36.044384 808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [term 3 LEADER]: Becoming Leader. State: Replica: 661f673a84e24fe19095fcd3419df995, State: Running, Role: LEADER
I20260808 08:50:36.044803 801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:36.045073 808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } }
I20260808 08:50:36.055382 810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 661f673a84e24fe19095fcd3419df995. Latest consensus state: current_term: 3 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:36.055729 810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:36.055874 809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "661f673a84e24fe19095fcd3419df995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "661f673a84e24fe19095fcd3419df995" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 39383 } } }
I20260808 08:50:36.056207 809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 661f673a84e24fe19095fcd3419df995 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:36.057389 840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:36.066244 840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:36.067734 840 catalog_manager.cc:1259] Loaded cluster ID: 9375dadf294c4c3f8646a7c5f6536601
I20260808 08:50:36.067843 840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 08:50:36.070171 840 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fea33a399ad google::LogMessage::Fail() at ??:0
@ 0x7fea33a3c88a google::LogMessage::SendToLog() at ??:0
@ 0x7fea33a394de google::LogMessage::Flush() at ??:0
@ 0x7fea33a3aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fea49470512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fea4946d976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fea494f5610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fea494f5439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fea36685345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fea3668891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fea36688799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fea36663eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fea3993d6db start_thread at ??:0
@ 0x7fea328d361f clone at ??:0
W20260808 08:50:36.429778 803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:36.430034 803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:36.430195 803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:36.437325 803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:36.437424 803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:36.437644 803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:36.446990 803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:34057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=46651
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:36.448252 803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:36.449576 803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:36.462565 884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:36.462487 889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:36.462532 885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:36.463596 803 server_base.cc:1034] running on GCE node
I20260808 08:50:36.464264 803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:36.465158 803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:36.466363 803 hybrid_clock.cc:648] HybridClock initialized: now 1786179036466305 us; error 60 us; skew 500 ppm
I20260808 08:50:36.466682 803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:36 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179036, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:36.470311 803 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:36.472049 803 webserver.cc:460] Webserver started at http://127.8.149.65:46651/ using document root <none> and password file <none>
I20260808 08:50:36.472821 803 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:36.473017 803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:36.478390 803 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:50:36.481325 897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:36.482656 803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:50:36.482844 803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "addb68ea9720480f852de15b762747a1"
format_stamp: "Formatted at 2026-08-08 08:50:30 on dist-test-slave-7vjv"
server_key: "02850ae6957f159b19784db1c2a01efc"
server_key_iv: "75670cff532e22c0889799dce875b507"
server_key_version: "encryptionkey@0"
I20260808 08:50:36.483803 803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:36.514648 803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:36.518822 803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:36.519135 803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:36.520196 803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:36.521509 803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:36.521620 803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:36.521771 803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:36.521888 803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:36.557242 803 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:34057
I20260808 08:50:36.557328 1085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:34057 every 8 connection(s)
I20260808 08:50:36.558730 803 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:36.563365 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:36.561577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:60893)
0808 08:50:36.562299 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:36.562526 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":281,"threads_started":1}
I20260808 08:50:36.563601 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 803
W20260808 08:50:36.564132 1086 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:39383 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:39383: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
I20260808 08:50:36.564368 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:38485
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=43909
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:50:36.565021 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:36.564670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:49237)
0808 08:50:36.564816 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:36.564898 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 08:50:36.565949 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:36.565638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:38971)
0808 08:50:36.565764 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:36.565836 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:50:36.566205 1086 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:50:36.906244 1093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:36.906479 1093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:36.906563 1093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:36.913362 1093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:36.913460 1093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:36.913550 1093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:36.922406 1093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:38485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=43909
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:36.923456 1093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:36.924679 1093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:36.937383 1101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:36.937343 1100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:36.937422 1105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:36.938473 1093 server_base.cc:1034] running on GCE node
I20260808 08:50:36.939101 1093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:36.939967 1093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:36.941200 1093 hybrid_clock.cc:648] HybridClock initialized: now 1786179036941172 us; error 87 us; skew 500 ppm
I20260808 08:50:36.941504 1093 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:36 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179036, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:36.944614 1093 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:36.945847 1093 webserver.cc:460] Webserver started at http://127.8.149.66:43909/ using document root <none> and password file <none>
I20260808 08:50:36.946457 1093 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:36.946578 1093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:36.951646 1093 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:50:36.954312 1116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:36.955513 1093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:50:36.955673 1093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "2aca2e6be3db40df93ba18d202001ded"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "07e4ad42985d5346cb824777d2077f58"
server_key_iv: "94c3b01cd4deb747e6e837c546c95053"
server_key_version: "encryptionkey@0"
I20260808 08:50:36.956637 1093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:36.971648 1093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:36.975806 1093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:36.976110 1093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:36.977037 1093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:36.978423 1093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:36.978542 1093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:36.978673 1093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:36.978767 1093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:37.013681 1093 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:38485
I20260808 08:50:37.013772 1313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:38485 every 8 connection(s)
I20260808 08:50:37.015230 1093 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:37.019972 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.018288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:37031)
0808 08:50:37.018969 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.019170 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":265,"threads_started":1}
W20260808 08:50:37.020695 1314 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:39383 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:39383: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
I20260808 08:50:37.021441 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.021169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:57687)
0808 08:50:37.021283 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.021344 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 08:50:37.022225 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.021933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:52411)
0808 08:50:37.022061 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.022137 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:50:37.022446 1314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:50:37.023309 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 1093
I20260808 08:50:37.024020 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:44607
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:39383
--webserver_port=40437
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:37.342648 1318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:37.342916 1318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:37.343080 1318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:37.349581 1318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:37.349689 1318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:37.349858 1318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:37.358438 1318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:44607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=40437
--tserver_master_addrs=127.8.149.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:37.359513 1318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:37.360961 1318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:37.373235 1332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:37.373188 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:37.373322 1340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:37.374310 1318 server_base.cc:1034] running on GCE node
I20260808 08:50:37.374859 1318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:37.375705 1318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:37.376956 1318 hybrid_clock.cc:648] HybridClock initialized: now 1786179037376921 us; error 43 us; skew 500 ppm
I20260808 08:50:37.377272 1318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:37 dist-test-slave-7vjv krb5kdc[31356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179037, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:37.380410 1318 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:37.381794 1318 webserver.cc:460] Webserver started at http://127.8.149.67:40437/ using document root <none> and password file <none>
I20260808 08:50:37.382604 1318 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:37.382752 1318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:37.387980 1318 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:50:37.390749 1351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:37.392424 1318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:50:37.392575 1318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "e531859e6f7b4352bcecc3b9e4724a6f"
format_stamp: "Formatted at 2026-08-08 08:50:31 on dist-test-slave-7vjv"
server_key: "06830f0f34de4cdad38d17371f379d03"
server_key_iv: "3a6440e18f288c25ec7e2329a9d6b36d"
server_key_version: "encryptionkey@0"
I20260808 08:50:37.393795 1318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:37.416610 1318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:37.420732 1318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:37.421057 1318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:37.422138 1318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:37.423696 1318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:37.423815 1318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:37.423964 1318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:37.424063 1318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:37.458936 1318 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44607
I20260808 08:50:37.459020 1563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44607 every 8 connection(s)
I20260808 08:50:37.460662 1318 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:37.461357 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 1318
I20260808 08:50:37.465379 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.463646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:50077)
0808 08:50:37.464364 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.464596 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":276,"threads_started":1}
W20260808 08:50:37.466078 1565 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:39383 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:39383: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
I20260808 08:50:37.466902 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.466593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:37293)
0808 08:50:37.466737 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.466806 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:50:37.467800 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.467487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:34925)
0808 08:50:37.467625 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.467697 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:50:37.468158 1565 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:50:37.567421 1573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:37.566687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:52669)
0808 08:50:37.567128 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:37.567207 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":204,"threads_started":1}
I20260808 08:50:38.023752 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:38.022952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:48367)
0808 08:50:38.023424 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:38.023543 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":245,"threads_started":1}
I20260808 08:50:38.469336 1578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:38.468557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:39953)
0808 08:50:38.469053 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:38.469132 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":209,"threads_started":1}
I20260808 08:50:38.569018 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:38.568270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:36243)
0808 08:50:38.568780 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:38.568858 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":235,"threads_started":1}
I20260808 08:50:39.025470 1580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:39.024646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:58999)
0808 08:50:39.025105 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:39.025183 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":229,"threads_started":1}
I20260808 08:50:39.470876 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:39.470209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:51071)
0808 08:50:39.470666 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:39.470736 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260808 08:50:39.570597 1583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:39.569864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:53293)
0808 08:50:39.570334 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:39.570434 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":260,"threads_started":1}
I20260808 08:50:40.027169 1585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:40.026490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:47463)
0808 08:50:40.026937 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:40.027020 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":225,"threads_started":1}
I20260808 08:50:40.472553 1588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:40.471746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:47189)
0808 08:50:40.472260 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:40.472351 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":242,"threads_started":1}
I20260808 08:50:40.572268 1591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:40.571509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:50717)
0808 08:50:40.571971 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:40.572048 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":242,"threads_started":1}
I20260808 08:50:41.028859 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:41.028180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:52941)
0808 08:50:41.028619 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:41.028692 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":228,"threads_started":1}
I20260808 08:50:41.474056 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:41.473372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:47055)
0808 08:50:41.473788 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:41.473884 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":200,"threads_started":1}
I20260808 08:50:41.573834 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:41.573156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:45153)
0808 08:50:41.573592 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:41.573670 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":239,"threads_started":1}
I20260808 08:50:42.030351 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:42.029691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:55277)
0808 08:50:42.030126 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:42.030200 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":240,"threads_started":1}
I20260808 08:50:42.475737 1596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:42.474921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:40531)
0808 08:50:42.475481 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:42.475565 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":302,"threads_started":1}
I20260808 08:50:42.575603 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:42.574823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:46653)
0808 08:50:42.575307 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:42.575440 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":254,"threads_started":1}
I20260808 08:50:43.031944 1601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:43.031245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:36409)
0808 08:50:43.031701 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:43.031785 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":233,"threads_started":1}
I20260808 08:50:43.477289 1602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:43.476610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:36385)
0808 08:50:43.477048 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:43.477135 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":232,"threads_started":1}
I20260808 08:50:43.577232 1603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:43.576524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:38359)
0808 08:50:43.576963 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:43.577042 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":198,"threads_started":1}
I20260808 08:50:44.033595 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:44.032816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:43753)
0808 08:50:44.033305 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:44.033381 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":195,"threads_started":1}
I20260808 08:50:44.479131 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:44.478326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:39871)
0808 08:50:44.478826 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:44.478913 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":230,"threads_started":1}
I20260808 08:50:44.578917 1608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:44.578091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:55069)
0808 08:50:44.578616 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:44.578693 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":322,"threads_started":1}
I20260808 08:50:45.035132 1614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:45.034449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:37831)
0808 08:50:45.034872 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:45.034980 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":245,"threads_started":1}
I20260808 08:50:45.480818 1617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:45.480006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:53231)
0808 08:50:45.480556 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:45.480649 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":304,"threads_started":1}
I20260808 08:50:45.580583 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:45.579726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:36155)
0808 08:50:45.580261 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:45.580416 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":213,"threads_started":1}
I20260808 08:50:46.036705 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:46.035952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:37849)
0808 08:50:46.036464 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:46.036542 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":273,"threads_started":1}
I20260808 08:50:46.482474 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:46.481777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:41565)
0808 08:50:46.482231 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:46.482305 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":228,"threads_started":1}
I20260808 08:50:46.582163 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:46.581470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:59001)
0808 08:50:46.581931 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:46.582010 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":238,"threads_started":1}
I20260808 08:50:47.038295 1624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:47.037609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:36613)
0808 08:50:47.038067 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:47.038145 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":242,"threads_started":1}
I20260808 08:50:47.484287 1629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:47.483386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:55571)
0808 08:50:47.483922 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:47.484057 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":286,"threads_started":1}
I20260808 08:50:47.583664 1633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:47.583020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:42333)
0808 08:50:47.583415 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:47.583502 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":194,"threads_started":1}
I20260808 08:50:48.039917 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:48.039105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:43891)
0808 08:50:48.039672 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:48.039755 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":361,"threads_started":1}
I20260808 08:50:48.485926 1640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:48.485176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:53337)
0808 08:50:48.485660 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:48.485752 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":258,"threads_started":1}
I20260808 08:50:48.585275 1641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:48.584596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:42353)
0808 08:50:48.585026 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:48.585100 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":236,"threads_started":1}
I20260808 08:50:49.041673 1642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:49.040783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:55513)
0808 08:50:49.041401 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:49.041520 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":400,"threads_started":1}
I20260808 08:50:49.487462 1643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:49.486795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:59409)
0808 08:50:49.487232 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:49.487308 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":239,"threads_started":1}
I20260808 08:50:49.586926 1644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:49.586151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:53643)
0808 08:50:49.586592 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:49.586679 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":213,"threads_started":1}
I20260808 08:50:50.043326 1645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:50.042565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:53389)
0808 08:50:50.043028 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:50.043152 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":246,"threads_started":1}
I20260808 08:50:50.489356 1646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:50.488541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:59429)
0808 08:50:50.489031 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:50.489122 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":229,"threads_started":1}
I20260808 08:50:50.588790 1647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:50.587837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:49853)
0808 08:50:50.588499 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:50.588597 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":396,"threads_started":1}
I20260808 08:50:51.044922 1648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:51.044174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:58049)
0808 08:50:51.044662 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:51.044739 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":284,"threads_started":1}
I20260808 08:50:51.490828 1649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:51.490125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:43041)
0808 08:50:51.490557 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:51.490654 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":213,"threads_started":1}
I20260808 08:50:51.590505 1650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:51.589859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.65:45677)
0808 08:50:51.590241 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:51.590321 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":194,"threads_started":1}
I20260808 08:50:52.046766 1652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:52.046093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.66:32927)
0808 08:50:52.046510 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:52.046604 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":206,"threads_started":1}
I20260808 08:50:52.464123 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 803
I20260808 08:50:52.482591 1654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:52.465243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.8.149.65:34057)
0808 08:50:52.466145 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:52.466159 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:52.466194 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:50:52.467847 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:52.467856 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:52.468331 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:52.468682 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:52.470141 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.471345 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.472582 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.473237 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.473491 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:52.476165 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:52.476174 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:52.476187 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:52.476222 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:52.479115 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.479866 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.479881 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.479886 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.480058 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.480543 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.480550 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.480553 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.481086 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:52.481415 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:52.481912 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 08:50:52.482303 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":601,"threads_started":1}
I20260808 08:50:52.483973 1079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:52.492817 1656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:52.491979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:39383 (local address 127.8.149.67:52521)
0808 08:50:52.492509 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:52.492628 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":259,"threads_started":1}
I20260808 08:50:52.564253 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 803
I20260808 08:50:52.591506 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 1093
I20260808 08:50:52.609400 1657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:52.592580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37120 (local address 127.8.149.66:38485)
0808 08:50:52.593156 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:52.593171 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:52.593208 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:50:52.594732 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:52.594740 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:52.595150 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:52.595515 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:52.597093 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.598388 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.599770 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.600491 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.600722 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:52.603217 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:52.603225 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:52.603237 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:52.603271 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:52.605992 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.606672 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.606678 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.606684 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.606846 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.607250 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.607255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.607260 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.607736 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:52.608047 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:52.608498 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 08:50:52.608953 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":252,"threads_started":1}
I20260808 08:50:52.611245 1306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:52.699925 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 1093
I20260808 08:50:52.727491 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 1318
I20260808 08:50:52.745223 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:52.728531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56014 (local address 127.8.149.67:44607)
0808 08:50:52.729134 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:52.729149 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:52.729190 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:50:52.730809 (+ 1619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:52.730818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:52.731240 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:52.731521 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:52.733043 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.734228 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.735546 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:52.736223 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:52.736348 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:52.739372 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:52.739378 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:52.739391 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:52.739424 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:52.742123 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.742767 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.742773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.742778 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.742958 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:52.743309 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:52.743311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:52.743313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:52.743775 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:52.744019 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:52.744523 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 08:50:52.744888 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":255,"threads_started":1}
I20260808 08:50:52.746496 1556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:52.826642 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 1318
2026-08-08T08:50:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24376 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:50:52 dist-test-slave-7vjv krb5kdc[1667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:50:52 dist-test-slave-7vjv krb5kdc[1667](info): set up 2 sockets
Aug 08 08:50:52 dist-test-slave-7vjv krb5kdc[1667](info): commencing operation
krb5kdc: starting...
W20260808 08:50:54.129222 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:50:54 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:50:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:50:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:50:54.382875 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:46677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:54.727604 1689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:54.727896 1689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:54.728124 1689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:54.735189 1689 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:50:54.735270 1689 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:50:54.735357 1689 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:50:54.735432 1689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:50:54.735517 1689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:54.735630 1689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:54.735714 1689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:50:54.735787 1689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:50:54.744755 1689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:46677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:54.745841 1689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:54.747109 1689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:54.760020 1695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:54.760056 1697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:54.760133 1694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:54.765554 1689 server_base.cc:1034] running on GCE node
I20260808 08:50:54.766567 1689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:54.768149 1689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:54.769452 1689 hybrid_clock.cc:648] HybridClock initialized: now 1786179054769366 us; error 45 us; skew 500 ppm
I20260808 08:50:54.769896 1689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:54 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:54.776268 1689 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:50:54.777763 1689 webserver.cc:460] Webserver started at http://127.8.149.126:39957/ using document root <none> and password file <none>
I20260808 08:50:54.778518 1689 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:54.778673 1689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:54.779059 1689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:54.782351 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "a97b27d2b3484f118c906f1b40cf6d62"
format_stamp: "Formatted at 2026-08-08 08:50:54 on dist-test-slave-7vjv"
server_key: "01b977a9d37403bfa8aa7c3824511fae"
server_key_iv: "948b0e0f2dd7a42de7c0b82b9accfa63"
server_key_version: "encryptionkey@0"
I20260808 08:50:54.783231 1689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "a97b27d2b3484f118c906f1b40cf6d62"
format_stamp: "Formatted at 2026-08-08 08:50:54 on dist-test-slave-7vjv"
server_key: "01b977a9d37403bfa8aa7c3824511fae"
server_key_iv: "948b0e0f2dd7a42de7c0b82b9accfa63"
server_key_version: "encryptionkey@0"
I20260808 08:50:54.789125 1689 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:50:54.792796 1710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:54.794085 1689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:50:54.794267 1689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "a97b27d2b3484f118c906f1b40cf6d62"
format_stamp: "Formatted at 2026-08-08 08:50:54 on dist-test-slave-7vjv"
server_key: "01b977a9d37403bfa8aa7c3824511fae"
server_key_iv: "948b0e0f2dd7a42de7c0b82b9accfa63"
server_key_version: "encryptionkey@0"
I20260808 08:50:54.794473 1689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:54.811872 1689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:54.815641 1689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:54.815896 1689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:54.834481 1689 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:46677
I20260808 08:50:54.834508 1799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:46677 every 8 connection(s)
I20260808 08:50:54.835675 1689 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:50:54.836722 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 1689
I20260808 08:50:54.837041 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:50:54.837972 8789 external_mini_cluster.cc:1428] Setting key 2b935d83f95e2995828056120e7b3584
I20260808 08:50:54.839563 1801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:50:54 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:54.855324 1801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap starting.
I20260808 08:50:54.858208 1801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:54.859149 1801 log.cc:824] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:54.861632 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:54.840399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.8.149.126:46677)
0808 08:50:54.841246 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:54.841257 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:54.841296 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:50:54.842851 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:54.842872 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:54.843235 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:54.843559 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:54.845753 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:54.847067 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:54.849315 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:54.849934 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:54.850062 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:54.855157 (+ 5095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:54.855164 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:54.855175 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:54.855208 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:54.857945 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:54.858629 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:54.858635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:54.858640 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:54.858777 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:54.859180 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:54.859184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:54.859185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:54.859723 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:54.860031 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:54.860448 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 08:50:54.860818 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":441,"threads_started":1}
I20260808 08:50:54.861862 1801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: No bootstrap required, opened a new log
I20260808 08:50:54.869385 1801 raft_consensus.cc:348] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:50:54.869707 1801 raft_consensus.cc:374] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:54.869825 1801 raft_consensus.cc:729] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Initialized, Role: FOLLOWER
I20260808 08:50:54.870307 1801 consensus_queue.cc:260] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:50:54.870533 1801 raft_consensus.cc:388] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:50:54.870679 1801 raft_consensus.cc:482] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:50:54.870867 1801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:54.872865 1801 raft_consensus.cc:504] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:50:54.873301 1801 leader_election.cc:302] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a97b27d2b3484f118c906f1b40cf6d62; no voters:
I20260808 08:50:54.873864 1801 leader_election.cc:288] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:50:54.874006 1811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:54.874656 1811 raft_consensus.cc:686] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 LEADER]: Becoming Leader. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Running, Role: LEADER
I20260808 08:50:54.875173 1811 consensus_queue.cc:237] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:50:54.875725 1801 sys_catalog.cc:564] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:50:54.878060 1812 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:50:54.878372 1812 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:54.877768 1814 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a97b27d2b3484f118c906f1b40cf6d62. Latest consensus state: current_term: 1 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:50:54.878876 1814 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:50:54.880592 1820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:50:54.885977 1820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:50:54.895419 1820 catalog_manager.cc:1347] Generated new cluster ID: 6b558513726e4658acf493a384d1515e
I20260808 08:50:54.895527 1820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:50:54.909977 1820 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:50:54.911597 1820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:50:54.920545 1820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Generated new TSK 0
I20260808 08:50:54.921377 1820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:50:54.984776 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:55.317613 1843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:55.317982 1843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:55.318188 1843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:55.326484 1843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:55.326609 1843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:55.326866 1843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:50:55.338979 1843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:55.340086 1843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:55.341390 1843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:55.353591 1855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:55.353766 1849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:55.353695 1852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:55.354772 1843 server_base.cc:1034] running on GCE node
I20260808 08:50:55.355419 1843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:55.356492 1843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:55.357743 1843 hybrid_clock.cc:648] HybridClock initialized: now 1786179055357687 us; error 71 us; skew 500 ppm
I20260808 08:50:55.358063 1843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:55 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179055, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:55.361461 1843 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:50:55.362761 1843 webserver.cc:460] Webserver started at http://127.8.149.65:43283/ using document root <none> and password file <none>
I20260808 08:50:55.363392 1843 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:55.363524 1843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:55.363821 1843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:55.366541 1843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "2c31304ce892462fb08405936e5413e9"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "3fea76958af3da7daebbdf7e8dba355a"
server_key_iv: "11a4569315c557a9b0b873a59bdfd98f"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.367353 1843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "2c31304ce892462fb08405936e5413e9"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "3fea76958af3da7daebbdf7e8dba355a"
server_key_iv: "11a4569315c557a9b0b873a59bdfd98f"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.372740 1843 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:50:55.375975 1865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.377295 1843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:50:55.377465 1843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "2c31304ce892462fb08405936e5413e9"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "3fea76958af3da7daebbdf7e8dba355a"
server_key_iv: "11a4569315c557a9b0b873a59bdfd98f"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.377647 1843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:55.413815 1843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:55.417608 1843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:55.417907 1843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:55.418828 1843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:55.420189 1843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:55.420295 1843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.420431 1843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:55.420498 1843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.452644 1843 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:39153
I20260808 08:50:55.452728 2051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:39153 every 8 connection(s)
I20260808 08:50:55.453904 1843 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:50:55.460502 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 1843
I20260808 08:50:55.460729 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:50:55.461349 8789 external_mini_cluster.cc:1428] Setting key 15c05cbfa0d9f0578491f554a7901f70
Aug 08 08:50:55 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179055, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:55.474713 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:55.457725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:45449 (local address 127.8.149.126:46677)
0808 08:50:55.458646 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:55.458652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:55.458675 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:50:55.459996 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:55.460001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:55.460083 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:55.460409 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:55.462077 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.463038 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.464584 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.465044 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.465198 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:55.468960 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:55.468965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:55.468968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:55.469017 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:55.471686 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:55.472505 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:55.472512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:55.472515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:55.472641 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:55.473075 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:55.473080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:55.473083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:55.473356 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:55.473515 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:55.474162 (+ 647us) server_negotiation.cc:299] Negotiation successful
0808 08:50:55.474376 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":695,"threads_started":1}
I20260808 08:50:55.475857 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:55.457260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:45449)
0808 08:50:55.457963 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:55.458013 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:55.459697 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:55.460659 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:55.460672 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:55.461264 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:55.461902 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:55.461921 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.463190 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.463195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:55.464413 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:55.464426 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.465289 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.465299 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:55.465570 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:55.466310 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:55.466334 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:55.468695 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:55.471868 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:55.471877 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:55.471891 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:55.472389 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:55.472757 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:55.472762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:55.472765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:55.472947 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:55.473487 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:55.473494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:55.473793 (+ 299us) client_negotiation.cc:769] Sending connection context
0808 08:50:55.474048 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 08:50:55.474527 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":290,"threads_started":1}
I20260808 08:50:55.477295 2052 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:50:55.477593 2052 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:55.478256 2052 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:50:55.480345 1741 ts_manager.cc:194] Registered new tserver with Master: 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153)
I20260808 08:50:55.481874 1741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:45449
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:50:55.523295 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:55.841300 2062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:55.841578 2062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:55.841758 2062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:55.848129 2062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:55.848240 2062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:55.848392 2062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:50:55.856675 2062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:55.857735 2062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:55.858992 2062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:55.871682 2070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:55.871742 2071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:55.871651 2073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:55.876916 2062 server_base.cc:1034] running on GCE node
I20260808 08:50:55.877498 2062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:55.878311 2062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:55.879554 2062 hybrid_clock.cc:648] HybridClock initialized: now 1786179055879521 us; error 38 us; skew 500 ppm
I20260808 08:50:55.879858 2062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:55 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179055, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:55.883143 2062 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:50:55.884557 2062 webserver.cc:460] Webserver started at http://127.8.149.66:43399/ using document root <none> and password file <none>
I20260808 08:50:55.885228 2062 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:55.885332 2062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:55.885632 2062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:55.888293 2062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "ab8478e1d365410899bd841e87674e90"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "6237061f569f04d3e5310f7c515bdd6a"
server_key_iv: "6d23ae8bee530ba8ddef9cf51db02957"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.888988 2062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "ab8478e1d365410899bd841e87674e90"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "6237061f569f04d3e5310f7c515bdd6a"
server_key_iv: "6d23ae8bee530ba8ddef9cf51db02957"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.893787 2062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:50:55.897238 2091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.898495 2062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:50:55.898648 2062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "ab8478e1d365410899bd841e87674e90"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "6237061f569f04d3e5310f7c515bdd6a"
server_key_iv: "6d23ae8bee530ba8ddef9cf51db02957"
server_key_version: "encryptionkey@0"
I20260808 08:50:55.898823 2062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:55.928705 2062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:55.932469 2062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:55.932735 2062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:55.933619 2062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:55.934849 2062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:55.934922 2062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.935108 2062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:55.935158 2062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:55.967110 2062 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40157
I20260808 08:50:55.967193 2305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40157 every 8 connection(s)
I20260808 08:50:55.968377 2062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:50:55.975852 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 2062
I20260808 08:50:55.976161 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:50:55.976822 8789 external_mini_cluster.cc:1428] Setting key 481d2c357cb52ef9cf1b25567b71f740
Aug 08 08:50:55 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179055, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:55.991746 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:55.970915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:41255 (local address 127.8.149.126:46677)
0808 08:50:55.971130 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:55.971137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:55.972381 (+ 1244us) server_negotiation.cc:407] Connection header received
0808 08:50:55.974077 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:55.974081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:55.974145 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:55.974246 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:55.975699 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.976931 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.979110 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.979623 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.979717 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:55.984327 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:55.984337 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:55.984344 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:55.984402 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:55.988180 (+ 3778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:55.989010 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:55.989018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:55.989024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:55.989203 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:55.989677 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:55.989685 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:55.989690 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:55.990091 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:55.990258 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:55.990986 (+ 728us) server_negotiation.cc:299] Negotiation successful
0808 08:50:55.991250 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:50:55.992594 2309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:55.971449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:41255)
0808 08:50:55.972214 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:55.972251 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:55.973819 (+ 1568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:55.974441 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:55.974448 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:55.974928 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:55.975473 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:55.975491 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.977187 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.977194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:55.978924 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:55.978938 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:55.979866 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:55.979877 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:55.980287 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:55.981067 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:55.981103 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:55.984062 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:55.988318 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:55.988328 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:55.988343 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:55.988880 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:55.989328 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:55.989334 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:55.989340 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:55.989552 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:55.990224 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:55.990233 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:55.990610 (+ 377us) client_negotiation.cc:769] Sending connection context
0808 08:50:55.990864 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 08:50:55.991327 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":278,"threads_started":1}
I20260808 08:50:55.994109 2306 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:50:55.994381 2306 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:55.995021 2306 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:50:55.996492 1741 ts_manager.cc:194] Registered new tserver with Master: ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
I20260808 08:50:55.997371 1741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:41255
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:50:56.043555 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:50:56.372272 2317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:50:56.372520 2317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:50:56.372617 2317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:50:56.379666 2317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:50:56.379765 2317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:50:56.379911 2317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:50:56.389242 2317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:50:56.390388 2317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:50:56.391623 2317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:50:56.405314 2331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:56.405350 2327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:50:56.405267 2328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:50:56.406375 2317 server_base.cc:1034] running on GCE node
I20260808 08:50:56.406996 2317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:50:56.407850 2317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:50:56.409060 2317 hybrid_clock.cc:648] HybridClock initialized: now 1786179056408994 us; error 61 us; skew 500 ppm
I20260808 08:50:56.409375 2317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:50:56 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179056, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:50:56.412721 2317 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:50:56.414031 2317 webserver.cc:460] Webserver started at http://127.8.149.67:39821/ using document root <none> and password file <none>
I20260808 08:50:56.414647 2317 fs_manager.cc:359] Metadata directory not provided
I20260808 08:50:56.414748 2317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:50:56.415004 2317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:50:56.417692 2317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "98180ece10aa48009c011609db407677"
format_stamp: "Formatted at 2026-08-08 08:50:56 on dist-test-slave-7vjv"
server_key: "2d94e4ac4412d393983e2d8a4bec6e8f"
server_key_iv: "5b3043875c54716ec5b9d8f7e1d14489"
server_key_version: "encryptionkey@0"
I20260808 08:50:56.418357 2317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "98180ece10aa48009c011609db407677"
format_stamp: "Formatted at 2026-08-08 08:50:56 on dist-test-slave-7vjv"
server_key: "2d94e4ac4412d393983e2d8a4bec6e8f"
server_key_iv: "5b3043875c54716ec5b9d8f7e1d14489"
server_key_version: "encryptionkey@0"
I20260808 08:50:56.423277 2317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:50:56.426589 2344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:56.427942 2317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:50:56.428161 2317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "98180ece10aa48009c011609db407677"
format_stamp: "Formatted at 2026-08-08 08:50:56 on dist-test-slave-7vjv"
server_key: "2d94e4ac4412d393983e2d8a4bec6e8f"
server_key_iv: "5b3043875c54716ec5b9d8f7e1d14489"
server_key_version: "encryptionkey@0"
I20260808 08:50:56.428375 2317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:50:56.452775 2317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:50:56.457223 2317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:50:56.457581 2317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:50:56.458846 2317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:50:56.460649 2317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:50:56.460744 2317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:56.460865 2317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:50:56.460950 2317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:50:56.484633 2052 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:50:56.494304 2317 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:43767
I20260808 08:50:56.494345 2537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:43767 every 8 connection(s)
I20260808 08:50:56.495647 2317 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:50:56.497087 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 2317
I20260808 08:50:56.497274 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:50:56.497860 8789 external_mini_cluster.cc:1428] Setting key 07bece866e38f9b9b21407a061c644a5
Aug 08 08:50:56 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179056, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:50:56.516427 2540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.498415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:45009 (local address 127.8.149.126:46677)
0808 08:50:56.498961 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.498967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.500153 (+ 1186us) server_negotiation.cc:407] Connection header received
0808 08:50:56.502139 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.502143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.502205 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.502290 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:56.503847 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.504637 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.506218 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.506745 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.506832 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.510445 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:56.510449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:56.510460 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:56.510492 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:56.513644 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.514398 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.514401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.514404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.514524 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.514919 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.514922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.514924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.515182 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:56.515308 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.515933 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.516086 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":260,"threads_started":1}
I20260808 08:50:56.517318 2542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.499027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:45009)
0808 08:50:56.499977 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.500038 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.501860 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.502506 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.502513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.503105 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:50:56.503702 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.503718 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.504787 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.504791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.506078 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.506091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.506964 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.506969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.507167 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.507735 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:50:56.507757 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:50:56.510267 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:50:56.513771 (+ 3504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:56.513776 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:56.513786 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:56.514280 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:56.514623 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:50:56.514627 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:50:56.514629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:50:56.514814 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:50:56.515312 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:50:56.515317 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:50:56.515594 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.515843 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.516287 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":398,"threads_started":1}
I20260808 08:50:56.518615 2538 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:50:56.518851 2538 heartbeater.cc:464] Registering TS with master...
I20260808 08:50:56.519465 2538 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:50:56.520758 1741 ts_manager.cc:194] Registered new tserver with Master: 98180ece10aa48009c011609db407677 (127.8.149.67:43767)
I20260808 08:50:56.521564 1741 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:45009
I20260808 08:50:56.525429 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:50:56.541621 2540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.529872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37574 (local address 127.8.149.126:46677)
0808 08:50:56.530036 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.530039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.530558 (+ 519us) server_negotiation.cc:407] Connection header received
0808 08:50:56.530687 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.530690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.530744 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.530823 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:56.532322 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.533075 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.534462 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.534784 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.534867 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.537021 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:56.537025 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:56.537028 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:56.537053 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:56.539535 (+ 2482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.540148 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.540152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.540154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.540257 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.540567 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.540570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.540572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.540843 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:56.541014 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.541267 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.541420 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:50:56.545429 1741 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:50:56.551821 1741 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:50:56.589740 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.564943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35958 (local address 127.8.149.65:39153)
0808 08:50:56.580378 (+ 15435us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.580401 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.581149 (+ 748us) server_negotiation.cc:407] Connection header received
0808 08:50:56.581461 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.581470 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.581716 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.581892 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:56.582995 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.584542 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.586951 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.588465 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.588611 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.588911 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.589179 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.589343 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15203,"thread_start_us":15449,"threads_started":1}
I20260808 08:50:56.589955 2571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.565088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.8.149.67:43767)
0808 08:50:56.580711 (+ 15623us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.580721 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.580755 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:50:56.580862 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.580870 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.581135 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.581567 (+ 432us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:56.582502 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.584271 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.587226 (+ 2955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.588603 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.588710 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.588910 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.589454 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.589609 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15447,"thread_start_us":16101,"threads_started":1}
I20260808 08:50:56.590492 2573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.581572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40157 (local address 127.0.0.1:53230)
0808 08:50:56.582400 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.582425 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.582617 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.583415 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.583418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.583435 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:56.583722 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.583729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.585854 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.585859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.587745 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.587757 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.589503 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.589509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.589682 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.589720 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.589822 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.590032 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":1,"thread_start_us":466,"threads_started":1}
I20260808 08:50:56.590667 2566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.564683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:43767 (local address 127.0.0.1:57284)
0808 08:50:56.579369 (+ 14686us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.579426 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.579657 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.581661 (+ 2004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.581669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.581697 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:56.582245 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.582259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.584409 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.584415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.587050 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.587083 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.589057 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.589066 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.589242 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.589273 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.590175 (+ 902us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.590285 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14365,"mutex_wait_us":33,"thread_start_us":16078,"threads_started":1}
I20260808 08:50:56.590811 2564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.564687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:35958)
0808 08:50:56.581014 (+ 16327us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.581032 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.581242 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.582306 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.582321 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.582348 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:56.582810 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.582824 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.584724 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.584728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.586787 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.586799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.588678 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.588684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.588896 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.588943 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.590128 (+ 1185us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.590257 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16217,"mutex_wait_us":49,"thread_start_us":15148,"threads_started":1}
I20260808 08:50:56.591248 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.580929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53230 (local address 127.8.149.66:40157)
0808 08:50:56.581546 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.581555 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.582519 (+ 964us) server_negotiation.cc:407] Connection header received
0808 08:50:56.582821 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.582828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.583052 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.583189 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:56.583889 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.585623 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.587893 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.589071 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.589193 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.589352 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.590768 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.590947 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":361,"threads_started":1}
I20260808 08:50:56.594761 2171 tablet_service.cc:1467] Processing CreateTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c (DEFAULT_TABLE table=test-table [id=dc84ab688b154618a1230fdeb9d949de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:56.594807 2426 tablet_service.cc:1467] Processing CreateTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c (DEFAULT_TABLE table=test-table [id=dc84ab688b154618a1230fdeb9d949de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:56.595458 1942 tablet_service.cc:1467] Processing CreateTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c (DEFAULT_TABLE table=test-table [id=dc84ab688b154618a1230fdeb9d949de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:50:56.595973 2171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eee92ca8f0034cdf8edfb7e080c77c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:56.596313 2426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eee92ca8f0034cdf8edfb7e080c77c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:56.596750 1942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eee92ca8f0034cdf8edfb7e080c77c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:50:56.608536 2575 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Bootstrap starting.
I20260808 08:50:56.610662 2576 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Bootstrap starting.
I20260808 08:50:56.612155 2575 tablet_bootstrap.cc:654] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:56.612785 2577 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Bootstrap starting.
I20260808 08:50:56.614282 2576 tablet_bootstrap.cc:654] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:56.614615 2575 log.cc:824] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:56.615533 2577 tablet_bootstrap.cc:654] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Neither blocks nor log segments found. Creating new log.
I20260808 08:50:56.615604 2576 log.cc:824] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:56.616761 2577 log.cc:824] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Log is configured to *not* fsync() on all Append() calls
I20260808 08:50:56.618607 2575 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: No bootstrap required, opened a new log
I20260808 08:50:56.618718 2576 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: No bootstrap required, opened a new log
I20260808 08:50:56.618893 2575 ts_tablet_manager.cc:1397] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260808 08:50:56.618990 2576 ts_tablet_manager.cc:1397] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260808 08:50:56.619596 2577 tablet_bootstrap.cc:492] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: No bootstrap required, opened a new log
I20260808 08:50:56.619838 2577 ts_tablet_manager.cc:1397] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:50:56.625757 2575 raft_consensus.cc:348] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.626089 2575 raft_consensus.cc:374] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:56.626220 2575 raft_consensus.cc:729] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8478e1d365410899bd841e87674e90, State: Initialized, Role: FOLLOWER
I20260808 08:50:56.626820 2575 consensus_queue.cc:260] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.628736 2575 ts_tablet_manager.cc:1428] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260808 08:50:56.628043 2306 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:50:56.629312 2576 raft_consensus.cc:348] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.629691 2576 raft_consensus.cc:374] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:56.629799 2576 raft_consensus.cc:729] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c31304ce892462fb08405936e5413e9, State: Initialized, Role: FOLLOWER
I20260808 08:50:56.630020 2577 raft_consensus.cc:348] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.630436 2577 raft_consensus.cc:374] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:50:56.630554 2577 raft_consensus.cc:729] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98180ece10aa48009c011609db407677, State: Initialized, Role: FOLLOWER
I20260808 08:50:56.630475 2576 consensus_queue.cc:260] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.631141 2577 consensus_queue.cc:260] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.632449 2538 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:50:56.633163 2577 ts_tablet_manager.cc:1428] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260808 08:50:56.637290 2576 ts_tablet_manager.cc:1428] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Time spent starting tablet: real 0.018s user 0.012s sys 0.007s
I20260808 08:50:56.682080 2585 raft_consensus.cc:482] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:50:56.682402 2585 raft_consensus.cc:504] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.683910 2585 leader_election.cc:288] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153), 98180ece10aa48009c011609db407677 (127.8.149.67:43767)
I20260808 08:50:56.691313 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.684494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:40245 (local address 127.8.149.65:39153)
0808 08:50:56.684672 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.684676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.685322 (+ 646us) server_negotiation.cc:407] Connection header received
0808 08:50:56.685543 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.685548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.685638 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.685727 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:56.686442 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.687347 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.689376 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.690315 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.690443 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.690492 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.690914 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.691070 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:50:56.691403 2592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.684423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.8.149.66:40245)
0808 08:50:56.685213 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.685228 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.685388 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.685747 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.685751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.685776 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:56.686233 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.686248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.687488 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.687495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.689203 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.689221 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.690540 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.690547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.690727 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.690770 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.690889 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.691035 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":448,"threads_started":1}
I20260808 08:50:56.691835 2571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.684327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:33715 (local address 127.8.149.67:43767)
0808 08:50:56.684509 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.684513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.685870 (+ 1357us) server_negotiation.cc:407] Connection header received
0808 08:50:56.686140 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.686148 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.686238 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.686342 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:50:56.686967 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.687949 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.689881 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.690867 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.691024 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.691095 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.691488 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.691626 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:50:56.692502 2593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.684894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:43767 (local address 127.8.149.66:33715)
0808 08:50:56.685739 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 08:50:56.685754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:50:56.685990 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:50:56.686374 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:50:56.686380 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:50:56.686410 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:50:56.686775 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.686787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.688133 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.688138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.689710 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:50:56.689724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.691082 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.691088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:50:56.691278 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.691313 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:50:56.692009 (+ 696us) client_negotiation.cc:240] Negotiation successful
0808 08:50:56.692191 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":459,"threads_started":1}
I20260808 08:50:56.692576 1978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eee92ca8f0034cdf8edfb7e080c77c5c" candidate_uuid: "ab8478e1d365410899bd841e87674e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c31304ce892462fb08405936e5413e9" is_pre_election: true
I20260808 08:50:56.693126 1978 raft_consensus.cc:2454] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab8478e1d365410899bd841e87674e90 in term 0.
I20260808 08:50:56.693483 2454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eee92ca8f0034cdf8edfb7e080c77c5c" candidate_uuid: "ab8478e1d365410899bd841e87674e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98180ece10aa48009c011609db407677" is_pre_election: true
I20260808 08:50:56.693756 2098 leader_election.cc:302] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c31304ce892462fb08405936e5413e9, ab8478e1d365410899bd841e87674e90; no voters:
I20260808 08:50:56.694115 2585 raft_consensus.cc:2781] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:50:56.694132 2454 raft_consensus.cc:2454] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab8478e1d365410899bd841e87674e90 in term 0.
I20260808 08:50:56.694285 2585 raft_consensus.cc:482] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:50:56.694422 2585 raft_consensus.cc:3037] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:56.696820 2585 raft_consensus.cc:504] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.697429 2585 leader_election.cc:288] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [CANDIDATE]: Term 1 election: Requested vote from peers 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153), 98180ece10aa48009c011609db407677 (127.8.149.67:43767)
I20260808 08:50:56.697885 2454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eee92ca8f0034cdf8edfb7e080c77c5c" candidate_uuid: "ab8478e1d365410899bd841e87674e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98180ece10aa48009c011609db407677"
I20260808 08:50:56.697888 1978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eee92ca8f0034cdf8edfb7e080c77c5c" candidate_uuid: "ab8478e1d365410899bd841e87674e90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c31304ce892462fb08405936e5413e9"
I20260808 08:50:56.698055 1978 raft_consensus.cc:3037] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:56.698089 2454 raft_consensus.cc:3037] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:50:56.700215 1978 raft_consensus.cc:2454] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab8478e1d365410899bd841e87674e90 in term 1.
I20260808 08:50:56.700578 2098 leader_election.cc:302] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c31304ce892462fb08405936e5413e9, ab8478e1d365410899bd841e87674e90; no voters:
I20260808 08:50:56.700593 2454 raft_consensus.cc:2454] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab8478e1d365410899bd841e87674e90 in term 1.
I20260808 08:50:56.700870 2585 raft_consensus.cc:2781] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:50:56.701336 2585 raft_consensus.cc:686] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 1 LEADER]: Becoming Leader. State: Replica: ab8478e1d365410899bd841e87674e90, State: Running, Role: LEADER
I20260808 08:50:56.701784 2585 consensus_queue.cc:237] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:50:56.706349 1741 catalog_manager.cc:5495] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab8478e1d365410899bd841e87674e90 (127.8.149.66). New cstate: current_term: 1 leader_uuid: "ab8478e1d365410899bd841e87674e90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } health_report { overall_health: HEALTHY } } }
W20260808 08:50:56.707544 2053 tablet.cc:2369] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:50:56.720361 2307 tablet.cc:2369] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:50:56.722518 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.717434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53244 (local address 127.8.149.66:40157)
0808 08:50:56.717596 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.717600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.717700 (+ 100us) server_negotiation.cc:407] Connection header received
0808 08:50:56.717853 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.717857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.717934 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.718052 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:50:56.718352 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.719002 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.720521 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.720965 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.721057 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.721557 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:50:56.722001 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:50:56.722137 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.722226 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.722285 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:50:56.730221 1978 raft_consensus.cc:1261] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Refusing update from remote peer ab8478e1d365410899bd841e87674e90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:56.730262 2454 raft_consensus.cc:1261] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Refusing update from remote peer ab8478e1d365410899bd841e87674e90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:50:56.731138 2594 consensus_queue.cc:1035] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:56.731444 2585 consensus_queue.cc:1035] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:50:56.741822 2600 mvcc.cc:205] Tried to move back new op lower bound from 7316189416357183488 to 7316189416254083072. Current Snapshot: MvccSnapshot[applied={T|T < 7316189416357183488}]
I20260808 08:50:56.755266 1741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:56.755491 1741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:50:56.758780 1741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Sending DeleteTablet for 3 replicas of tablet eee92ca8f0034cdf8edfb7e080c77c5c
I20260808 08:50:56.759773 1942 tablet_service.cc:1514] Processing DeleteTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:56 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:35958
I20260808 08:50:56.759922 2426 tablet_service.cc:1514] Processing DeleteTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:56 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:57284
I20260808 08:50:56.760810 2171 tablet_service.cc:1514] Processing DeleteTablet for tablet eee92ca8f0034cdf8edfb7e080c77c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:50:56 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:53230
I20260808 08:50:56.761061 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 1843
I20260808 08:50:56.772081 2612 tablet_replica.cc:330] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: stopping tablet replica
I20260808 08:50:56.772517 2612 raft_consensus.cc:2229] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:56.773010 2612 raft_consensus.cc:2258] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:56.773746 2613 tablet_replica.cc:330] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: stopping tablet replica
I20260808 08:50:56.774115 2613 raft_consensus.cc:2229] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:50:56.774569 2613 raft_consensus.cc:2258] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:56.775110 2614 tablet_replica.cc:330] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: stopping tablet replica
I20260808 08:50:56.775508 2614 raft_consensus.cc:2229] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:50:56.776196 2614 raft_consensus.cc:2258] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:50:56.776774 2613 ts_tablet_manager.cc:1905] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:56.778713 2614 ts_tablet_manager.cc:1905] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:50:56.782970 2612 ts_tablet_manager.cc:1905] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:50:56 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:50:56.786204 2614 ts_tablet_manager.cc:1918] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:56.786375 2614 log.cc:1196] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/eee92ca8f0034cdf8edfb7e080c77c5c
I20260808 08:50:56.786980 2614 ts_tablet_manager.cc:1939] T eee92ca8f0034cdf8edfb7e080c77c5c P ab8478e1d365410899bd841e87674e90: Deleting consensus metadata
I20260808 08:50:56.788822 1714 catalog_manager.cc:4841] TS ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): tablet eee92ca8f0034cdf8edfb7e080c77c5c (table test-table [id=dc84ab688b154618a1230fdeb9d949de]) successfully deleted
I20260808 08:50:56.790269 2613 ts_tablet_manager.cc:1918] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:56.790452 2613 log.cc:1196] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/eee92ca8f0034cdf8edfb7e080c77c5c
I20260808 08:50:56.790897 2613 ts_tablet_manager.cc:1939] T eee92ca8f0034cdf8edfb7e080c77c5c P 98180ece10aa48009c011609db407677: Deleting consensus metadata
I20260808 08:50:56.792235 1712 catalog_manager.cc:4841] TS 98180ece10aa48009c011609db407677 (127.8.149.67:43767): tablet eee92ca8f0034cdf8edfb7e080c77c5c (table test-table [id=dc84ab688b154618a1230fdeb9d949de]) successfully deleted
I20260808 08:50:56.793350 2612 ts_tablet_manager.cc:1918] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:50:56.793522 2612 log.cc:1196] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/eee92ca8f0034cdf8edfb7e080c77c5c
I20260808 08:50:56.793978 2612 ts_tablet_manager.cc:1939] T eee92ca8f0034cdf8edfb7e080c77c5c P 2c31304ce892462fb08405936e5413e9: Deleting consensus metadata
I20260808 08:50:56.794555 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.762344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35974 (local address 127.8.149.65:39153)
0808 08:50:56.762527 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.762533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.771985 (+ 9452us) server_negotiation.cc:407] Connection header received
0808 08:50:56.772353 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.772359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.772444 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.772523 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:56.776222 (+ 3699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.777355 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.779981 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.780641 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.780745 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.786789 (+ 6044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:56.786804 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:56.786821 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:56.786870 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:56.790853 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.791784 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.791793 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.791796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.791958 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.792462 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.792467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.792470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.792931 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:56.793232 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.793865 (+ 633us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.794105 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:50:56.795437 1714 catalog_manager.cc:4841] TS 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153): tablet eee92ca8f0034cdf8edfb7e080c77c5c (table test-table [id=dc84ab688b154618a1230fdeb9d949de]) successfully deleted
I20260808 08:50:56.795913 2045 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:56.897171 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 1843
I20260808 08:50:56.922866 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 2062
Aug 08 08:50:56 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:50:56.941586 2572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:56.923871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.8.149.66:40157)
0808 08:50:56.924044 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:56.924049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:56.924067 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:50:56.924216 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:56.924219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:56.924279 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:56.924363 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:56.926125 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.927133 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.929209 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:56.929647 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:56.929737 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:56.934778 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:56.934792 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:56.934809 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:56.934858 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:56.938654 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.939370 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.939386 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.939390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.939565 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:56.939925 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:56.939930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:56.939933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:56.940444 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:56.940767 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:56.940964 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 08:50:56.941178 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:50:56.942327 2300 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:57.053099 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 2062
I20260808 08:50:57.079788 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 2317
Aug 08 08:50:57 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:50:57.094424 2571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:50:57.080625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57296 (local address 127.8.149.67:43767)
0808 08:50:57.080792 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:50:57.080800 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:50:57.080818 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:50:57.080969 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:50:57.080973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:50:57.081033 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:50:57.081144 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:50:57.082469 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:57.083199 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:57.084558 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:50:57.084986 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:50:57.085081 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:50:57.089287 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:50:57.089298 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:50:57.089313 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:50:57.089342 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:50:57.092161 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:57.092724 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:57.092731 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:57.092733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:57.092855 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:50:57.093192 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:50:57.093195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:50:57.093196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:50:57.093512 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:50:57.093729 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:50:57.093955 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 08:50:57.094098 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:50:57.095058 2531 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:57.180294 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 2317
I20260808 08:50:57.203452 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 1689
I20260808 08:50:57.204675 1794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:50:57.310710 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 1689
I20260808 08:51:17.341970 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--webserver_interface=127.8.149.126
--webserver_port=39957
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:46677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:17.667203 2627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:17.667572 2627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:17.667732 2627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:17.676954 2627 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:51:17.677073 2627 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:51:17.677146 2627 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:51:17.677222 2627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:51:17.677325 2627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:17.677429 2627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:17.677505 2627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:51:17.677583 2627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:51:17.688966 2627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:46677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=39957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:17.690193 2627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:17.691505 2627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:17.716825 2638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:17.716730 2643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:17.716766 2639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:17.717602 2627 server_base.cc:1034] running on GCE node
I20260808 08:51:17.718505 2627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:17.720000 2627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:17.721254 2627 hybrid_clock.cc:648] HybridClock initialized: now 1786179077721185 us; error 40 us; skew 500 ppm
I20260808 08:51:17.721662 2627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:17 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179077, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:17.729900 2627 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:51:17.731510 2627 webserver.cc:460] Webserver started at http://127.8.149.126:39957/ using document root <none> and password file <none>
I20260808 08:51:17.732420 2627 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:17.732573 2627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:17.738389 2627 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:51:17.741353 2655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:17.742617 2627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:51:17.742807 2627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "a97b27d2b3484f118c906f1b40cf6d62"
format_stamp: "Formatted at 2026-08-08 08:50:54 on dist-test-slave-7vjv"
server_key: "01b977a9d37403bfa8aa7c3824511fae"
server_key_iv: "948b0e0f2dd7a42de7c0b82b9accfa63"
server_key_version: "encryptionkey@0"
I20260808 08:51:17.743841 2627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:17.756667 2627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:17.760476 2627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:17.760756 2627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:17.779469 2627 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:46677
I20260808 08:51:17.779541 2744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:46677 every 8 connection(s)
I20260808 08:51:17.781006 2627 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:51:17.787635 2748 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:51:17.789466 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 2627
I20260808 08:51:17.790458 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:39153
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=43283
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:51:17.791715 2748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap starting.
I20260808 08:51:17.814262 2748 log.cc:824] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:17.825672 2748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:51:17.826176 2748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap complete.
I20260808 08:51:17.835201 2748 raft_consensus.cc:348] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:17.835961 2748 raft_consensus.cc:729] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Initialized, Role: FOLLOWER
I20260808 08:51:17.836635 2748 consensus_queue.cc:260] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:17.836879 2748 raft_consensus.cc:388] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:51:17.837004 2748 raft_consensus.cc:482] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:51:17.837210 2748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:51:17.840898 2748 raft_consensus.cc:504] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:17.841454 2748 leader_election.cc:302] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a97b27d2b3484f118c906f1b40cf6d62; no voters:
I20260808 08:51:17.842118 2748 leader_election.cc:288] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:51:17.842250 2752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:51:17.843551 2752 raft_consensus.cc:686] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 LEADER]: Becoming Leader. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Running, Role: LEADER
I20260808 08:51:17.844236 2752 consensus_queue.cc:237] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:17.844507 2748 sys_catalog.cc:564] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:51:17.846887 2755 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a97b27d2b3484f118c906f1b40cf6d62. Latest consensus state: current_term: 2 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:51:17.847383 2755 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:17.847883 2753 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:51:17.848357 2753 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:17.851620 2765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:51:17.859195 2765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:51:17.860814 2765 catalog_manager.cc:1259] Loaded cluster ID: 6b558513726e4658acf493a384d1515e
I20260808 08:51:17.860949 2765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:51:17.865485 2765 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:51:17.866983 2765 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Loaded TSK: 0
I20260808 08:51:17.900172 2765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Generated new TSK 1
I20260808 08:51:17.900595 2765 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:51:18.137885 2750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:18.138162 2750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:18.138296 2750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:18.145038 2750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:18.145155 2750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:18.145323 2750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:51:18.154243 2750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:39153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=43283
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:18.155300 2750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:18.156563 2750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:18.170441 2795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:18.170544 2789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:18.171113 2798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:18.171375 2750 server_base.cc:1034] running on GCE node
I20260808 08:51:18.172070 2750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:18.173218 2750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:18.174472 2750 hybrid_clock.cc:648] HybridClock initialized: now 1786179078174421 us; error 35 us; skew 500 ppm
I20260808 08:51:18.174816 2750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:18 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179078, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:18.178596 2750 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:51:18.180167 2750 webserver.cc:460] Webserver started at http://127.8.149.65:43283/ using document root <none> and password file <none>
I20260808 08:51:18.180822 2750 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:18.180991 2750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:18.186725 2750 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:51:18.189548 2808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.190824 2750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:18.190991 2750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "2c31304ce892462fb08405936e5413e9"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "3fea76958af3da7daebbdf7e8dba355a"
server_key_iv: "11a4569315c557a9b0b873a59bdfd98f"
server_key_version: "encryptionkey@0"
I20260808 08:51:18.191973 2750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:18.209607 2750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:18.213794 2750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:18.214089 2750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:18.215026 2750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:18.216456 2750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:18.216589 2750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.216727 2750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:18.216835 2750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.249837 2750 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:39153
I20260808 08:51:18.249966 2983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:39153 every 8 connection(s)
I20260808 08:51:18.251256 2750 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:51:18.261313 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 2750
I20260808 08:51:18.262009 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:40157
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=43399
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:51:18 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179078, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:51:18.274888 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:18.254238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:51747)
0808 08:51:18.255136 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:18.255187 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:18.256942 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:18.258153 (+ 1211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:18.258159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:18.258580 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:18.259032 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:18.259046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.260552 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.260556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:18.261673 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:18.261685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.263032 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.263037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:18.263203 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:18.263805 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:51:18.263824 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:51:18.265866 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:51:18.270442 (+ 4576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:18.270452 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:18.270466 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:18.270972 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:18.271444 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:18.271450 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:18.271455 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:18.271646 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:18.272584 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:51:18.272592 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:51:18.272955 (+ 363us) client_negotiation.cc:769] Sending connection context
0808 08:51:18.273206 (+ 251us) client_negotiation.cc:240] Negotiation successful
0808 08:51:18.273667 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":374,"threads_started":1}
I20260808 08:51:18.275171 2987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:18.254023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:51747 (local address 127.8.149.126:46677)
0808 08:51:18.254590 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:18.254602 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:18.255342 (+ 740us) server_negotiation.cc:407] Connection header received
0808 08:51:18.257427 (+ 2085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:18.257440 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:18.257739 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:18.258045 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:18.259194 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.260408 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.261828 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.262841 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.263046 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:18.266142 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:18.266154 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:18.266172 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:18.266231 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:18.270273 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:18.271107 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:18.271117 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:18.271126 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:18.271323 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:18.271753 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:18.271760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:18.271765 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:18.272457 (+ 692us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:18.272638 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:18.273438 (+ 800us) server_negotiation.cc:299] Negotiation successful
0808 08:51:18.273870 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":273,"threads_started":1}
I20260808 08:51:18.278055 2984 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:51:18.278339 2984 heartbeater.cc:464] Registering TS with master...
I20260808 08:51:18.278988 2984 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:51:18.281116 2684 ts_manager.cc:194] Registered new tserver with Master: 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153)
I20260808 08:51:18.282583 2684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:51747
W20260808 08:51:18.600658 2989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:18.600966 2989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:18.601136 2989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:18.608155 2989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:18.608297 2989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:18.608479 2989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:51:18.617748 2989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:40157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=43399
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:18.618968 2989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:18.620322 2989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:18.633666 2997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:18.634087 2999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:18.633733 2996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:18.634291 2989 server_base.cc:1034] running on GCE node
I20260808 08:51:18.634895 2989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:18.635756 2989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:18.636991 2989 hybrid_clock.cc:648] HybridClock initialized: now 1786179078636971 us; error 73 us; skew 500 ppm
I20260808 08:51:18.637327 2989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:18 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179078, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:18.640472 2989 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:51:18.641796 2989 webserver.cc:460] Webserver started at http://127.8.149.66:43399/ using document root <none> and password file <none>
I20260808 08:51:18.642442 2989 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:18.642560 2989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:18.647699 2989 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:51:18.650519 3012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.651757 2989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:51:18.651952 2989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "ab8478e1d365410899bd841e87674e90"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "6237061f569f04d3e5310f7c515bdd6a"
server_key_iv: "6d23ae8bee530ba8ddef9cf51db02957"
server_key_version: "encryptionkey@0"
I20260808 08:51:18.652889 2989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:18.667629 2989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:18.672012 2989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:18.672333 2989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:18.673352 2989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:18.674722 2989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:18.674875 2989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.675016 2989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:18.675132 2989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:18.708005 2989 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40157
I20260808 08:51:18.708155 3209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40157 every 8 connection(s)
I20260808 08:51:18.709545 2989 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:51:18.714191 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 2989
I20260808 08:51:18.714836 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:43767
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=39821
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:51:18 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179078, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:51:18.731040 2987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:18.712001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:52729 (local address 127.8.149.126:46677)
0808 08:51:18.712276 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:18.712283 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:18.713347 (+ 1064us) server_negotiation.cc:407] Connection header received
0808 08:51:18.715259 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:18.715268 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:18.715379 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:18.715495 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:18.717045 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.718229 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.719717 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.720514 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.720672 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:18.724026 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:18.724035 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:18.724043 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:18.724116 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:18.727771 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:18.728626 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:18.728633 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:18.728636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:18.728800 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:18.729348 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:18.729351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:18.729354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:18.729640 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:18.729777 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:18.730578 (+ 801us) server_negotiation.cc:299] Negotiation successful
0808 08:51:18.730756 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 08:51:18.732353 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:18.712479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:52729)
0808 08:51:18.713195 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:18.713235 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:18.714881 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:18.715720 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:18.715727 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:18.716296 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:18.716843 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:18.716858 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.718396 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.718400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:18.719552 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:18.719564 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:18.720713 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:18.720718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:18.720899 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:18.721683 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:51:18.721704 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:51:18.723784 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:51:18.727925 (+ 4141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:18.727931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:18.727940 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:18.728504 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:18.728985 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:18.728992 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:18.728998 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:18.729229 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:18.729786 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:51:18.729797 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:51:18.730187 (+ 390us) client_negotiation.cc:769] Sending connection context
0808 08:51:18.730462 (+ 275us) client_negotiation.cc:240] Negotiation successful
0808 08:51:18.730961 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":301,"threads_started":1}
I20260808 08:51:18.733919 3210 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:51:18.734242 3210 heartbeater.cc:464] Registering TS with master...
I20260808 08:51:18.735059 3210 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:51:18.736665 2684 ts_manager.cc:194] Registered new tserver with Master: ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
I20260808 08:51:18.737500 2684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:52729
W20260808 08:51:19.042709 3216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:19.042948 3216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:19.043088 3216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:19.049764 3216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:19.049850 3216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:19.050046 3216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:51:19.059468 3216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:43767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=39821
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:19.060691 3216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:19.061987 3216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:19.074815 3227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:19.074783 3234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:19.074849 3231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:19.075736 3216 server_base.cc:1034] running on GCE node
I20260808 08:51:19.076351 3216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:19.077159 3216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:19.078413 3216 hybrid_clock.cc:648] HybridClock initialized: now 1786179079078359 us; error 51 us; skew 500 ppm
I20260808 08:51:19.078727 3216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:19 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179079, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:19.081766 3216 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:51:19.083163 3216 webserver.cc:460] Webserver started at http://127.8.149.67:39821/ using document root <none> and password file <none>
I20260808 08:51:19.083818 3216 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:19.083983 3216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:19.088774 3216 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:19.091984 3248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:19.093336 3216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:51:19.093515 3216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "98180ece10aa48009c011609db407677"
format_stamp: "Formatted at 2026-08-08 08:50:56 on dist-test-slave-7vjv"
server_key: "2d94e4ac4412d393983e2d8a4bec6e8f"
server_key_iv: "5b3043875c54716ec5b9d8f7e1d14489"
server_key_version: "encryptionkey@0"
I20260808 08:51:19.094460 3216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:19.125713 3216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:19.129598 3216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:19.129858 3216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:19.130764 3216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:19.131938 3216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:19.132068 3216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:19.132216 3216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:19.132308 3216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:19.166100 3216 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:43767
I20260808 08:51:19.166177 3436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:43767 every 8 connection(s)
I20260808 08:51:19.167492 3216 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:51:19.176985 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 3216
Aug 08 08:51:19 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179079, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:51:19.188207 2987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.170046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:57343 (local address 127.8.149.126:46677)
0808 08:51:19.170234 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.170239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.171273 (+ 1034us) server_negotiation.cc:407] Connection header received
0808 08:51:19.172964 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.172987 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.173050 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.173142 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.174487 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.175171 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.176782 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.177440 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.177590 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.181731 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.181736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.181739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.181771 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.184572 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.185515 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.185519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.185521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.185636 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.186140 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.186143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.186145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.186380 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.186506 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.187451 (+ 945us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.187687 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:51:19.188901 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.170420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:57343)
0808 08:51:19.171100 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.171149 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.172722 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.173328 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.173335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.173811 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:19.174329 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.174345 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.175320 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.175324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.176628 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.176641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.177698 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.177709 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.178037 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.178924 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:51:19.178945 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:51:19.181545 (+ 2600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:51:19.184733 (+ 3188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:19.184740 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:19.184749 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:19.185357 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:19.185756 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:19.185762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:19.185767 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:19.186023 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:19.186530 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:51:19.186540 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:51:19.186961 (+ 421us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.187314 (+ 353us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.187808 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":273,"threads_started":1}
I20260808 08:51:19.190387 3438 heartbeater.cc:347] Connected to a master server at 127.8.149.126:46677
I20260808 08:51:19.190675 3438 heartbeater.cc:464] Registering TS with master...
I20260808 08:51:19.191339 3438 heartbeater.cc:511] Master 127.8.149.126:46677 requested a full tablet report, sending...
I20260808 08:51:19.192837 2684 ts_manager.cc:194] Registered new tserver with Master: 98180ece10aa48009c011609db407677 (127.8.149.67:43767)
I20260808 08:51:19.193467 3442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.178048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34574 (local address 127.8.149.126:46677)
0808 08:51:19.178529 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.178533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.179217 (+ 684us) server_negotiation.cc:407] Connection header received
0808 08:51:19.179340 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.179345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.179411 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.179521 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.181302 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.182067 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.183470 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.183944 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.184084 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.187558 (+ 3474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.187564 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.187568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.187601 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.190706 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.191382 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.191387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.191398 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.191524 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.191929 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.191934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.191937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.192274 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.192562 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.192890 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.193091 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":278,"threads_started":1}
I20260808 08:51:19.193979 2684 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:57343
I20260808 08:51:19.196025 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:51:19.202306 3442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.196933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34582 (local address 127.8.149.126:46677)
0808 08:51:19.197084 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.197088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.197600 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:51:19.197760 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.197763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.197891 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.198036 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:51:19.198520 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.199233 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.200670 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.201054 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.201144 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.201616 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:51:19.201844 (+ 228us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 08:51:19.202114 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34582: token expired
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 08:51:19.202422 3442 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34582: token expired
W20260808 08:51:19.203044 2544 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.149.126:46677)
I20260808 08:51:19.215488 3442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.203510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34584 (local address 127.8.149.126:46677)
0808 08:51:19.203657 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.203664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.203685 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:51:19.203849 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.203854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.203936 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.204034 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.205306 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.205954 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.207179 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.207565 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.207707 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.210226 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.210231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.210243 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.210270 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.212930 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.213587 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.213592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.213596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.213725 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.214108 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.214114 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.214117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.214402 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.214645 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.214951 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.215169 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:51:19.218540 2684 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34584:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:51:19.225788 2684 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:51:19.261899 3455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.237031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:43767 (local address 127.0.0.1:43790)
0808 08:51:19.247223 (+ 10192us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.247262 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.247437 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.250364 (+ 2927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.250374 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.250427 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:51:19.250912 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.250927 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.253992 (+ 3065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.253997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.256476 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.256490 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.260855 (+ 4365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.260863 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.261137 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.261196 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.261318 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.261518 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9522,"thread_start_us":11689,"threads_started":1}
I20260808 08:51:19.262249 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.238087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57458 (local address 127.8.149.65:39153)
0808 08:51:19.248662 (+ 10575us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.248674 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.249279 (+ 605us) server_negotiation.cc:407] Connection header received
0808 08:51:19.254060 (+ 4781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.254066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.254235 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.254373 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:51:19.255208 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.256648 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.259282 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.260806 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.260936 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.261178 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.261739 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.261911 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10371,"thread_start_us":10168,"threads_started":1}
I20260808 08:51:19.263022 3454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.237242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:57458)
0808 08:51:19.249006 (+ 11764us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.249027 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.253853 (+ 4826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.254643 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.254648 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.254669 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:51:19.255046 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.255058 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.256826 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.256831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.259065 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.259083 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.261376 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.261382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.261543 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.261574 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.262517 (+ 943us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.262656 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11612,"thread_start_us":9145,"threads_started":1}
I20260808 08:51:19.266119 3456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.237379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.8.149.67:43767)
0808 08:51:19.249570 (+ 12191us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.249581 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.249617 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:51:19.249739 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.249748 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.250097 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.251152 (+ 1055us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:51:19.251525 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.253751 (+ 2226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.258048 (+ 4297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.260609 (+ 2561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.263001 (+ 2392us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.263262 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.263337 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.263498 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11852,"thread_start_us":11677,"threads_started":1}
I20260808 08:51:19.266688 2876 tablet_service.cc:1467] Processing CreateTablet for tablet d11346a6aac440ebafbe9a85e6320bff (DEFAULT_TABLE table=test-table [id=3a4e40ebc25a4bd2b5b6a1741b66594b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:51:19.268198 2876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11346a6aac440ebafbe9a85e6320bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:51:19.269213 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.249442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40157 (local address 127.0.0.1:46252)
0808 08:51:19.253166 (+ 3724us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.253183 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.253297 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.254018 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.254024 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.254055 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:51:19.255916 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.255931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.258530 (+ 2599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.258537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.266473 (+ 7936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.266486 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.268358 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.268366 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.268541 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.268572 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.268666 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.268811 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3602,"thread_start_us":3467,"threads_started":1}
I20260808 08:51:19.270133 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.247461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.8.149.66:40157)
0808 08:51:19.252776 (+ 5315us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.252784 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.253420 (+ 636us) server_negotiation.cc:407] Connection header received
0808 08:51:19.253510 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.253517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.253816 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.256170 (+ 2354us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:51:19.256512 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.258349 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.266690 (+ 8341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.268031 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.268227 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.268413 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.269662 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.269827 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5151,"thread_start_us":5024,"threads_started":1}
I20260808 08:51:19.269606 3330 tablet_service.cc:1467] Processing CreateTablet for tablet d11346a6aac440ebafbe9a85e6320bff (DEFAULT_TABLE table=test-table [id=3a4e40ebc25a4bd2b5b6a1741b66594b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:51:19.271070 3330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11346a6aac440ebafbe9a85e6320bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:51:19.276072 3097 tablet_service.cc:1467] Processing CreateTablet for tablet d11346a6aac440ebafbe9a85e6320bff (DEFAULT_TABLE table=test-table [id=3a4e40ebc25a4bd2b5b6a1741b66594b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:51:19.277365 3097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11346a6aac440ebafbe9a85e6320bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:51:19.285368 2984 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:51:19.291513 3466 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Bootstrap starting.
I20260808 08:51:19.296499 3465 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Bootstrap starting.
I20260808 08:51:19.298287 3466 tablet_bootstrap.cc:654] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Neither blocks nor log segments found. Creating new log.
I20260808 08:51:19.299679 3466 log.cc:824] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:19.301015 3465 tablet_bootstrap.cc:654] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Neither blocks nor log segments found. Creating new log.
I20260808 08:51:19.302451 3465 log.cc:824] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:19.304216 3469 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Bootstrap starting.
I20260808 08:51:19.306742 3469 tablet_bootstrap.cc:654] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Neither blocks nor log segments found. Creating new log.
I20260808 08:51:19.307852 3469 log.cc:824] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:19.309870 3465 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: No bootstrap required, opened a new log
I20260808 08:51:19.310108 3466 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: No bootstrap required, opened a new log
I20260808 08:51:19.310144 3465 ts_tablet_manager.cc:1397] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260808 08:51:19.310353 3466 ts_tablet_manager.cc:1397] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260808 08:51:19.312637 3469 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: No bootstrap required, opened a new log
I20260808 08:51:19.312886 3469 ts_tablet_manager.cc:1397] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:51:19.320902 3465 raft_consensus.cc:348] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.321348 3465 raft_consensus.cc:374] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:51:19.321460 3465 raft_consensus.cc:729] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c31304ce892462fb08405936e5413e9, State: Initialized, Role: FOLLOWER
I20260808 08:51:19.321506 3466 raft_consensus.cc:348] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.321897 3466 raft_consensus.cc:374] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:51:19.321996 3466 raft_consensus.cc:729] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98180ece10aa48009c011609db407677, State: Initialized, Role: FOLLOWER
I20260808 08:51:19.322187 3465 consensus_queue.cc:260] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.322557 3466 consensus_queue.cc:260] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.324885 3469 raft_consensus.cc:348] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.325266 3469 raft_consensus.cc:374] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:51:19.325352 3469 raft_consensus.cc:729] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8478e1d365410899bd841e87674e90, State: Initialized, Role: FOLLOWER
I20260808 08:51:19.326028 3465 ts_tablet_manager.cc:1428] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20260808 08:51:19.326046 3469 consensus_queue.cc:260] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.328421 3438 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:51:19.328989 3466 ts_tablet_manager.cc:1428] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Time spent starting tablet: real 0.019s user 0.013s sys 0.005s
I20260808 08:51:19.330376 3210 heartbeater.cc:503] Master 127.8.149.126:46677 was elected leader, sending a full tablet report...
I20260808 08:51:19.332072 3469 ts_tablet_manager.cc:1428] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Time spent starting tablet: real 0.019s user 0.017s sys 0.000s
I20260808 08:51:19.373906 3477 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:19.374185 3477 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.375936 3477 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
I20260808 08:51:19.381865 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.376246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42599 (local address 127.8.149.65:39153)
0808 08:51:19.376480 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.376484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.376662 (+ 178us) server_negotiation.cc:407] Connection header received
0808 08:51:19.376891 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.376897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.376974 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.377101 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:51:19.377492 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.378458 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.380081 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.380854 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.381018 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.381100 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.381478 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.381598 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:51:19.381893 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.376345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.8.149.67:42599)
0808 08:51:19.376565 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.376587 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.376726 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.377121 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.377125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.377152 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:51:19.377351 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.377360 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.378611 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.378616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.379915 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.379928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.381013 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.381019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.381284 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.381308 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.381450 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.381579 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":42}
I20260808 08:51:19.382875 2907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11346a6aac440ebafbe9a85e6320bff" candidate_uuid: "98180ece10aa48009c011609db407677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c31304ce892462fb08405936e5413e9" is_pre_election: true
I20260808 08:51:19.383369 2907 raft_consensus.cc:2454] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98180ece10aa48009c011609db407677 in term 0.
I20260808 08:51:19.383551 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.376911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:34219 (local address 127.8.149.66:40157)
0808 08:51:19.377169 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.377179 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.377843 (+ 664us) server_negotiation.cc:407] Connection header received
0808 08:51:19.377995 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.378000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.378068 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.378172 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:51:19.378735 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.379520 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.381432 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.382562 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.382775 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.382852 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.383138 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.383270 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:51:19.383690 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.376794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40157 (local address 127.8.149.67:34219)
0808 08:51:19.377733 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.377752 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:19.377868 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:19.378200 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:19.378204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:19.378222 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:51:19.378551 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.378564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.379687 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.379693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.381235 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:19.381251 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.382791 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.382797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:19.382970 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.382994 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:51:19.383110 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:51:19.383231 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"mutex_wait_us":23,"thread_start_us":609,"threads_started":1}
I20260808 08:51:19.384202 3256 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c31304ce892462fb08405936e5413e9, 98180ece10aa48009c011609db407677; no voters:
I20260808 08:51:19.384636 3477 raft_consensus.cc:2781] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:51:19.384809 3477 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:51:19.384951 3477 raft_consensus.cc:3037] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:51:19.385406 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11346a6aac440ebafbe9a85e6320bff" candidate_uuid: "98180ece10aa48009c011609db407677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab8478e1d365410899bd841e87674e90" is_pre_election: true
I20260808 08:51:19.385826 3134 raft_consensus.cc:2454] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98180ece10aa48009c011609db407677 in term 0.
I20260808 08:51:19.387452 3477 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.388031 3477 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [CANDIDATE]: Term 1 election: Requested vote from peers 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
I20260808 08:51:19.388648 2907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11346a6aac440ebafbe9a85e6320bff" candidate_uuid: "98180ece10aa48009c011609db407677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c31304ce892462fb08405936e5413e9"
I20260808 08:51:19.388665 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11346a6aac440ebafbe9a85e6320bff" candidate_uuid: "98180ece10aa48009c011609db407677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab8478e1d365410899bd841e87674e90"
I20260808 08:51:19.388857 3134 raft_consensus.cc:3037] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:51:19.388857 2907 raft_consensus.cc:3037] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:51:19.392016 2907 raft_consensus.cc:2454] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98180ece10aa48009c011609db407677 in term 1.
I20260808 08:51:19.392016 3134 raft_consensus.cc:2454] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98180ece10aa48009c011609db407677 in term 1.
I20260808 08:51:19.392371 3256 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90; no voters:
I20260808 08:51:19.392652 3477 raft_consensus.cc:2781] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:51:19.393074 3477 raft_consensus.cc:686] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 1 LEADER]: Becoming Leader. State: Replica: 98180ece10aa48009c011609db407677, State: Running, Role: LEADER
I20260808 08:51:19.393610 3477 consensus_queue.cc:237] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:19.398188 2684 catalog_manager.cc:5495] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98180ece10aa48009c011609db407677 (127.8.149.67). New cstate: current_term: 1 leader_uuid: "98180ece10aa48009c011609db407677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } health_report { overall_health: UNKNOWN } } }
W20260808 08:51:19.419123 3440 tablet.cc:2369] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:51:19.425817 3456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.420648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43800 (local address 127.8.149.67:43767)
0808 08:51:19.420812 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.420817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.420979 (+ 162us) server_negotiation.cc:407] Connection header received
0808 08:51:19.421150 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.421154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.421222 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.421339 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:51:19.421657 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.422321 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.423839 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.424404 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.424500 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.424993 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:51:19.425413 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:51:19.425523 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.425589 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.425646 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:51:19.432848 3134 raft_consensus.cc:1261] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Refusing update from remote peer 98180ece10aa48009c011609db407677: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:51:19.432971 2907 raft_consensus.cc:1261] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Refusing update from remote peer 98180ece10aa48009c011609db407677: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:51:19.433808 3482 consensus_queue.cc:1035] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:51:19.434154 3477 consensus_queue.cc:1035] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:51:19.459437 2679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:51:19.459743 2679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34584:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:51:19.463841 2679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Sending DeleteTablet for 3 replicas of tablet d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:19.465075 3330 tablet_service.cc:1514] Processing DeleteTablet for tablet d11346a6aac440ebafbe9a85e6320bff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:51:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:43790
I20260808 08:51:19.465071 2876 tablet_service.cc:1514] Processing DeleteTablet for tablet d11346a6aac440ebafbe9a85e6320bff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:51:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:57458
I20260808 08:51:19.465462 3097 tablet_service.cc:1514] Processing DeleteTablet for tablet d11346a6aac440ebafbe9a85e6320bff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:51:19 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:46252
I20260808 08:51:19.466665 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 2750
I20260808 08:51:19.475848 3503 tablet_replica.cc:330] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: stopping tablet replica
I20260808 08:51:19.477438 3503 raft_consensus.cc:2229] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:51:19.477939 3503 raft_consensus.cc:2258] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:51:19.479492 3502 tablet_replica.cc:330] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: stopping tablet replica
I20260808 08:51:19.479924 3502 raft_consensus.cc:2229] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:51:19.480707 3502 raft_consensus.cc:2258] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:51:19.482976 3503 ts_tablet_manager.cc:1905] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:51:19.488910 3501 tablet_replica.cc:330] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: stopping tablet replica
I20260808 08:51:19.489312 3501 raft_consensus.cc:2229] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:51:19.489825 3501 raft_consensus.cc:2258] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:51:19.491467 3458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.468463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36502 (local address 127.8.149.65:39153)
0808 08:51:19.468694 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.468703 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.469179 (+ 476us) server_negotiation.cc:407] Connection header received
0808 08:51:19.469259 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.469267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.469430 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.469537 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.472502 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.474124 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.476522 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.477396 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.477540 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.482079 (+ 4539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.482097 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.482114 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.482156 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.486389 (+ 4233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.487321 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.487332 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.487338 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.487522 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.488109 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.488115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.488119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.489115 (+ 996us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.489447 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.490815 (+ 1368us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.491057 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:51:19.491528 3502 ts_tablet_manager.cc:1905] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:51:19.492343 2977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:19.499521 3502 ts_tablet_manager.cc:1918] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:51:19.499722 3502 log.cc:1196] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:19.500335 3502 ts_tablet_manager.cc:1939] T d11346a6aac440ebafbe9a85e6320bff P 98180ece10aa48009c011609db407677: Deleting consensus metadata
I20260808 08:51:19.502039 2658 catalog_manager.cc:4841] TS 98180ece10aa48009c011609db407677 (127.8.149.67:43767): tablet d11346a6aac440ebafbe9a85e6320bff (table test-table [id=3a4e40ebc25a4bd2b5b6a1741b66594b]) successfully deleted
I20260808 08:51:19.502743 3503 ts_tablet_manager.cc:1918] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:51:19.502933 3503 log.cc:1196] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:19.503376 3503 ts_tablet_manager.cc:1939] T d11346a6aac440ebafbe9a85e6320bff P ab8478e1d365410899bd841e87674e90: Deleting consensus metadata
I20260808 08:51:19.504794 2660 catalog_manager.cc:4841] TS ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): tablet d11346a6aac440ebafbe9a85e6320bff (table test-table [id=3a4e40ebc25a4bd2b5b6a1741b66594b]) successfully deleted
I20260808 08:51:19.618764 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 2750
W20260808 08:51:19.648564 2660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.149.65:39153 (error 108)
I20260808 08:51:19.648864 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 2989
I20260808 08:51:19.650974 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.650493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36506)
0808 08:51:19.650660 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.650792 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:51:19.652382 2660 catalog_manager.cc:4584] TS 2c31304ce892462fb08405936e5413e9 (127.8.149.65:39153): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d11346a6aac440ebafbe9a85e6320bff: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
I20260808 08:51:19.665518 3460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.650251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.8.149.66:40157)
0808 08:51:19.650433 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.650439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.650461 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:51:19.650536 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.650541 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.650637 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.650754 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.652258 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.653425 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.654886 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.655521 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.655663 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.658370 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.658406 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.658426 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.658488 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.662615 (+ 4127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.663323 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.663334 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.663338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.663500 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.663848 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.663861 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.663864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.664390 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.664707 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.664888 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.665117 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:51:19.666229 3203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:19.706048 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.705535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36514)
0808 08:51:19.705763 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.705879 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:51:19.707254 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.706790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36526)
0808 08:51:19.706976 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.707073 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 08:51:19.754237 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 2989
I20260808 08:51:19.768146 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.767529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36528)
0808 08:51:19.767778 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.767916 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:51:19.769485 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.768999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36538)
0808 08:51:19.769194 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.769293 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 08:51:19.784991 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 3216
I20260808 08:51:19.803102 3456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.785798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42168 (local address 127.8.149.67:43767)
0808 08:51:19.785980 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:19.785987 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:19.786201 (+ 214us) server_negotiation.cc:407] Connection header received
0808 08:51:19.786415 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:19.786420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:19.786507 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:19.786618 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:19.788643 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.789793 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.791859 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:19.792522 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:19.792658 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:19.796277 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:19.796292 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:19.796309 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:19.796350 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:19.800224 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.801007 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.801014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.801017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.801196 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:19.801663 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:19.801666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:19.801668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:19.802018 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:19.802230 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:19.802597 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 08:51:19.802741 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:51:19.803797 3431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:19.850255 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.849846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36546)
0808 08:51:19.850031 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.850112 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:51:19.851364 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:19.851014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36552)
0808 08:51:19.851198 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:19.851265 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 08:51:19.923206 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 3216
I20260808 08:51:19.955070 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 2627
I20260808 08:51:19.956415 2738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:20.069233 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 2627
I20260808 08:51:20.069330 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:20.068363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:39153 (local address 127.0.0.1:36558)
0808 08:51:20.068846 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:20.068983 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:39153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:51:40.101493 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--webserver_interface=127.8.149.126
--webserver_port=39957
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:46677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:40.432606 3512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:40.432950 3512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:40.433110 3512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:40.439910 3512 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:51:40.440030 3512 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:51:40.440135 3512 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:51:40.440231 3512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:51:40.440311 3512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:40.440412 3512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:40.440483 3512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:51:40.440559 3512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:51:40.449332 3512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:46677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:46677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=39957
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:40.450428 3512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:40.451700 3512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:40.463675 3521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:40.463750 3518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:40.463719 3519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:40.464370 3512 server_base.cc:1034] running on GCE node
I20260808 08:51:40.465090 3512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:40.466385 3512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:40.467602 3512 hybrid_clock.cc:648] HybridClock initialized: now 1786179100467542 us; error 32 us; skew 500 ppm
I20260808 08:51:40.467875 3512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:40 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:40.470809 3512 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:51:40.472249 3512 webserver.cc:460] Webserver started at http://127.8.149.126:39957/ using document root <none> and password file <none>
I20260808 08:51:40.472834 3512 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:40.472923 3512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:40.478286 3512 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:51:40.481040 3532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:40.482316 3512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:51:40.482488 3512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "a97b27d2b3484f118c906f1b40cf6d62"
format_stamp: "Formatted at 2026-08-08 08:50:54 on dist-test-slave-7vjv"
server_key: "01b977a9d37403bfa8aa7c3824511fae"
server_key_iv: "948b0e0f2dd7a42de7c0b82b9accfa63"
server_key_version: "encryptionkey@0"
I20260808 08:51:40.483482 3512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:40.506037 3512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:40.509873 3512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:40.510169 3512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:40.529349 3512 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:46677
I20260808 08:51:40.529397 3628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:46677 every 8 connection(s)
I20260808 08:51:40.530936 3512 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:51:40.537573 3631 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:51:40.540343 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 3512
I20260808 08:51:40.540916 3631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap starting.
I20260808 08:51:40.541405 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:39153
--local_ip_for_outbound_sockets=127.8.149.65
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=43283
--webserver_interface=127.8.149.65
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:51:40.563647 3631 log.cc:824] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:40.578946 3631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:51:40.579452 3631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Bootstrap complete.
I20260808 08:51:40.589330 3631 raft_consensus.cc:348] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:40.590224 3631 raft_consensus.cc:729] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Initialized, Role: FOLLOWER
I20260808 08:51:40.590819 3631 consensus_queue.cc:260] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:40.591086 3631 raft_consensus.cc:388] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:51:40.591234 3631 raft_consensus.cc:482] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:51:40.591424 3631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:51:40.595101 3631 raft_consensus.cc:504] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:40.595626 3631 leader_election.cc:302] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a97b27d2b3484f118c906f1b40cf6d62; no voters:
I20260808 08:51:40.596379 3631 leader_election.cc:288] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:51:40.596509 3635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:51:40.597827 3635 raft_consensus.cc:686] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [term 3 LEADER]: Becoming Leader. State: Replica: a97b27d2b3484f118c906f1b40cf6d62, State: Running, Role: LEADER
I20260808 08:51:40.598371 3635 consensus_queue.cc:237] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } }
I20260808 08:51:40.598635 3631 sys_catalog.cc:564] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:51:40.601260 3637 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a97b27d2b3484f118c906f1b40cf6d62. Latest consensus state: current_term: 3 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:51:40.601651 3637 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:40.601320 3636 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a97b27d2b3484f118c906f1b40cf6d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97b27d2b3484f118c906f1b40cf6d62" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 46677 } } }
I20260808 08:51:40.601853 3636 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:40.606843 3644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:51:40.616204 3644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:51:40.617619 3644 catalog_manager.cc:1259] Loaded cluster ID: 6b558513726e4658acf493a384d1515e
I20260808 08:51:40.617724 3644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:51:40.622512 3644 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:51:40.624428 3644 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Loaded TSK: 0
I20260808 08:51:40.624579 3644 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a97b27d2b3484f118c906f1b40cf6d62: Loaded TSK: 1
F20260808 08:51:40.626070 3644 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f8b75e699ad google::LogMessage::Fail() at ??:0
@ 0x7f8b75e6c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f8b75e694de google::LogMessage::Flush() at ??:0
@ 0x7f8b75e6aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8b79bcd7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8b79bbc73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8b8b89c1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8b8b89b783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8b8b9272a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f8b8b9270c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f8b8b9715e9 std::function<>::operator()() at ??:0
@ 0x7f8b8b89fcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f8b8b89dc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8b8b925610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f8b8b925439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8b78ab5345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8b78ab891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f8b78ab8799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8b78a93eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8b7bd6d6db start_thread at ??:0
@ 0x7f8b74d0361f clone at ??:0
W20260808 08:51:40.956449 3633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:40.956703 3633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:40.956806 3633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:40.963603 3633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:40.963701 3633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:40.963814 3633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:51:40.972668 3633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:39153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=43283
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:40.973732 3633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:40.974931 3633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:40.988330 3707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:40.988435 3714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:40.988461 3709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:40.989673 3633 server_base.cc:1034] running on GCE node
I20260808 08:51:40.990274 3633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:40.991098 3633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:40.992321 3633 hybrid_clock.cc:648] HybridClock initialized: now 1786179100992256 us; error 45 us; skew 500 ppm
I20260808 08:51:40.992668 3633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:40 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:40.996222 3633 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:51:40.997686 3633 webserver.cc:460] Webserver started at http://127.8.149.65:43283/ using document root <none> and password file <none>
I20260808 08:51:40.998420 3633 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:40.998559 3633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:41.004271 3633 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:51:41.007371 3725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.008759 3633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:41.008941 3633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "2c31304ce892462fb08405936e5413e9"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "3fea76958af3da7daebbdf7e8dba355a"
server_key_iv: "11a4569315c557a9b0b873a59bdfd98f"
server_key_version: "encryptionkey@0"
I20260808 08:51:41.009934 3633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:41.022428 3633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:41.026934 3633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:41.027204 3633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:41.028316 3633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:41.030144 3735 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260808 08:51:41.035674 3633 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:51:41.035802 3633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 08:51:41.035943 3633 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:51:41.038992 3633 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:51:41.039091 3633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260808 08:51:41.039403 3735 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Bootstrap starting.
I20260808 08:51:41.047472 3735 log.cc:824] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:41.064450 3735 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:51:41.065251 3735 tablet_bootstrap.cc:492] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Bootstrap complete.
I20260808 08:51:41.065789 3735 ts_tablet_manager.cc:1397] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.004s
I20260808 08:51:41.076608 3735 raft_consensus.cc:348] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:41.078083 3735 raft_consensus.cc:729] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c31304ce892462fb08405936e5413e9, State: Initialized, Role: FOLLOWER
I20260808 08:51:41.078742 3735 consensus_queue.cc:260] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:41.080359 3735 ts_tablet_manager.cc:1428] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260808 08:51:41.084085 3633 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:39153
I20260808 08:51:41.084196 3920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:39153 every 8 connection(s)
I20260808 08:51:41.085227 3633 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:51:41.089619 3926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.087696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:38043)
0808 08:51:41.088545 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.088778 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":420,"threads_started":1}
W20260808 08:51:41.090216 3923 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:46677 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:46677: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
I20260808 08:51:41.091008 3926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.090668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:39173)
0808 08:51:41.090815 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.090911 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:51:41.091830 3926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.091507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:45501)
0808 08:51:41.091651 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.091724 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:51:41.092149 3923 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:51:41.094175 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 3633
I20260808 08:51:41.094810 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:40157
--local_ip_for_outbound_sockets=127.8.149.66
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=43399
--webserver_interface=127.8.149.66
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:41.433758 3929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:41.434028 3929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:41.434194 3929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:41.441195 3929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:41.441313 3929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:41.441507 3929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:51:41.450407 3929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:40157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=43399
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:41.451597 3929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:41.452992 3929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:41.465970 3936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:41.466041 3935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:41.466450 3942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:41.466663 3929 server_base.cc:1034] running on GCE node
I20260808 08:51:41.467217 3929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:41.468152 3929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:41.469381 3929 hybrid_clock.cc:648] HybridClock initialized: now 1786179101469334 us; error 52 us; skew 500 ppm
I20260808 08:51:41.469686 3929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:41 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179101, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:41.472929 3929 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:51:41.474344 3929 webserver.cc:460] Webserver started at http://127.8.149.66:43399/ using document root <none> and password file <none>
I20260808 08:51:41.474987 3929 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:41.475131 3929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:41.480813 3929 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:51:41.483508 3954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.484787 3929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:51:41.484994 3929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "ab8478e1d365410899bd841e87674e90"
format_stamp: "Formatted at 2026-08-08 08:50:55 on dist-test-slave-7vjv"
server_key: "6237061f569f04d3e5310f7c515bdd6a"
server_key_iv: "6d23ae8bee530ba8ddef9cf51db02957"
server_key_version: "encryptionkey@0"
I20260808 08:51:41.485987 3929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:41.502712 3929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:41.507068 3929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:41.507368 3929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:41.508289 3929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:41.509588 3929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:41.509680 3929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.509761 3929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:41.509824 3929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.544724 3929 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:40157
I20260808 08:51:41.544808 4143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:40157 every 8 connection(s)
I20260808 08:51:41.546223 3929 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:51:41.550546 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.548886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:53929)
0808 08:51:41.549560 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.549754 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":268,"threads_started":1}
W20260808 08:51:41.551192 4144 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:46677 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:46677: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
I20260808 08:51:41.551911 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.551613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:48949)
0808 08:51:41.551742 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.551805 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 08:51:41.552789 4146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:41.552473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:38979)
0808 08:51:41.552610 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:41.552697 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:51:41.553035 4144 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:51:41.553756 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 3929
I20260808 08:51:41.554319 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:43767
--local_ip_for_outbound_sockets=127.8.149.67
--tserver_master_addrs=127.8.149.126:46677
--webserver_port=39821
--webserver_interface=127.8.149.67
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:41.896481 4147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:41.896723 4147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:41.896808 4147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:41.903609 4147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:41.903704 4147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:41.903812 4147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:51:41.913130 4147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:43767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=39821
--tserver_master_addrs=127.8.149.126:46677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:41.914270 4147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:41.915550 4147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:41.928766 4152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:41.928809 4157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:41.928854 4153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:41.930508 4147 server_base.cc:1034] running on GCE node
I20260808 08:51:41.931047 4147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:41.931933 4147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:41.933130 4147 hybrid_clock.cc:648] HybridClock initialized: now 1786179101933072 us; error 53 us; skew 500 ppm
I20260808 08:51:41.933439 4147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:41 dist-test-slave-7vjv krb5kdc[1667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179101, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:41.937042 4147 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:51:41.938665 4147 webserver.cc:460] Webserver started at http://127.8.149.67:39821/ using document root <none> and password file <none>
I20260808 08:51:41.939302 4147 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:41.939410 4147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:41.944489 4147 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:41.947134 4167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.948421 4147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:41.948540 4147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "98180ece10aa48009c011609db407677"
format_stamp: "Formatted at 2026-08-08 08:50:56 on dist-test-slave-7vjv"
server_key: "2d94e4ac4412d393983e2d8a4bec6e8f"
server_key_iv: "5b3043875c54716ec5b9d8f7e1d14489"
server_key_version: "encryptionkey@0"
I20260808 08:51:41.949434 4147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:41.962939 4147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:41.966925 4147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:41.967131 4147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:41.968017 4147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:41.969341 4147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:41.969470 4147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:41.969565 4147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:41.969633 4147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:42.003232 4147 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:43767
I20260808 08:51:42.003353 4355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:43767 every 8 connection(s)
I20260808 08:51:42.004774 4147 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:51:42.009789 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.007795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:53011)
0808 08:51:42.008680 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.008914 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":371,"threads_started":1}
W20260808 08:51:42.010556 4356 heartbeater.cc:644] Failed to heartbeat to 127.8.149.126:46677 (0 consecutive failures): Network error: Failed to ping master at 127.8.149.126:46677: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
I20260808 08:51:42.011406 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.011049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:49263)
0808 08:51:42.011211 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.011291 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:51:42.012343 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.011983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:35711)
0808 08:51:42.012156 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.012240 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 08:51:42.012683 4356 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:51:42.012874 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 4147
I20260808 08:51:42.093277 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.092606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:46941)
0808 08:51:42.092995 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.093075 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":186,"threads_started":1}
I20260808 08:51:42.473061 4364 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:42.473390 4364 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:42.475006 4364 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98180ece10aa48009c011609db407677 (127.8.149.67:43767), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
Aug 08 08:51:42 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
Aug 08 08:51:42 dist-test-slave-7vjv krb5kdc[1667](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179100, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:51:42.498191 4365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.475354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:43767 (local address 127.8.149.65:34255)
0808 08:51:42.477782 (+ 2428us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.477799 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:42.477889 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:42.481084 (+ 3195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:42.481089 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:42.481620 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:42.482153 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:42.482166 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.483658 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.483661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:42.485519 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:42.485538 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.487075 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.487079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:42.487266 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:42.488015 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:51:42.488048 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:51:42.490839 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:51:42.494565 (+ 3726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:42.494585 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:42.494596 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:42.495019 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:42.495410 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:42.495414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:42.495418 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:42.495575 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:42.496640 (+ 1065us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:51:42.496647 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:51:42.497036 (+ 389us) client_negotiation.cc:769] Sending connection context
0808 08:51:42.497296 (+ 260us) client_negotiation.cc:240] Negotiation successful
0808 08:51:42.497735 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2315,"mutex_wait_us":237,"thread_start_us":1979,"threads_started":1}
I20260808 08:51:42.498313 4367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.475679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:34255 (local address 127.8.149.67:43767)
0808 08:51:42.477258 (+ 1579us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:42.477278 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:42.477903 (+ 625us) server_negotiation.cc:407] Connection header received
0808 08:51:42.479869 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:42.479880 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:42.480331 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:42.480647 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:42.482358 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.483461 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.485704 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.486624 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.486791 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:42.491108 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:42.491115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:42.491126 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:42.491159 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:42.494425 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:42.495145 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:42.495153 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:42.495163 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:42.495299 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:42.495709 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:42.495713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:42.495716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:42.496381 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:42.496567 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:42.497521 (+ 954us) server_negotiation.cc:299] Negotiation successful
0808 08:51:42.497904 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1339,"thread_start_us":1182,"threads_started":1}
I20260808 08:51:42.499096 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.475341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:40157 (local address 127.8.149.65:50711)
0808 08:51:42.475566 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.475618 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:42.476330 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:42.480597 (+ 4267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:42.480608 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:42.481454 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:42.482137 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:42.482155 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.483664 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.483668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:42.485519 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:42.485534 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.486896 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.486905 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:42.487291 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:42.488271 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:51:42.488302 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:51:42.491310 (+ 3008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:51:42.495994 (+ 4684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:42.495998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:42.496001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:42.496523 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:42.497027 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:51:42.497035 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:51:42.497040 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:51:42.497224 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:51:42.498276 (+ 1052us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:51:42.498280 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:51:42.498439 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 08:51:42.498586 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:51:42.498767 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":110,"spinlock_wait_cycles":22912}
I20260808 08:51:42.499616 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.475603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:50711 (local address 127.8.149.66:40157)
0808 08:51:42.477483 (+ 1880us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:42.477493 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:42.477525 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:51:42.479528 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:42.479540 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:42.480016 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:42.480431 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:42.482346 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.483473 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.485711 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:42.486624 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:42.486796 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:42.491621 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:42.491631 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:42.491648 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:42.491709 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:42.495845 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:42.496676 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:42.496683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:42.496689 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:42.496889 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:42.497381 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:42.497387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:42.497393 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:42.498136 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:42.498338 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:42.498832 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 08:51:42.499271 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1716,"thread_start_us":1607,"threads_started":1}
W20260808 08:51:42.502279 3727 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 98180ece10aa48009c011609db407677 (127.8.149.67:43767): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
W20260808 08:51:42.502535 3730 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:42.502698 3730 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c31304ce892462fb08405936e5413e9; no voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90
I20260808 08:51:42.503165 4364 raft_consensus.cc:2726] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:51:42.554389 4368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:42.553524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:52875)
0808 08:51:42.554037 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:42.554166 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":224,"threads_started":1}
I20260808 08:51:43.013953 4369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:43.013163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:59425)
0808 08:51:43.013610 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:43.013719 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":219,"threads_started":1}
I20260808 08:51:43.094820 4370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:43.094211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:35601)
0808 08:51:43.094606 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:43.094679 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":214,"threads_started":1}
I20260808 08:51:43.555860 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:43.555208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:34285)
0808 08:51:43.555644 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:43.555720 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":235,"threads_started":1}
I20260808 08:51:44.015447 4372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:44.014762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:39673)
0808 08:51:44.015202 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:44.015284 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":234,"threads_started":1}
I20260808 08:51:44.045845 4373 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:44.046118 4373 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:44.046736 4373 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98180ece10aa48009c011609db407677 (127.8.149.67:43767), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
W20260808 08:51:44.047914 3727 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 98180ece10aa48009c011609db407677 (127.8.149.67:43767): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
W20260808 08:51:44.048164 3730 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:44.048273 3730 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c31304ce892462fb08405936e5413e9; no voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90
I20260808 08:51:44.048522 4373 raft_consensus.cc:2726] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:51:44.096431 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:44.095634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:54753)
0808 08:51:44.096139 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:44.096248 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":220,"threads_started":1}
I20260808 08:51:44.557315 4375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:44.556670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:32953)
0808 08:51:44.557084 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:44.557161 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":218,"threads_started":1}
I20260808 08:51:45.016950 4376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:45.016302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:41849)
0808 08:51:45.016724 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:45.016803 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":220,"threads_started":1}
I20260808 08:51:45.097908 4377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:45.097235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:51643)
0808 08:51:45.097660 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:45.097740 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":237,"threads_started":1}
I20260808 08:51:45.558848 4378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:45.558186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:57075)
0808 08:51:45.558613 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:45.558695 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":228,"threads_started":1}
I20260808 08:51:46.018608 4379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:46.017776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:34467)
0808 08:51:46.018304 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:46.018420 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":277,"threads_started":1}
I20260808 08:51:46.099586 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:46.098889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:56969)
0808 08:51:46.099337 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:46.099430 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":216,"threads_started":1}
I20260808 08:51:46.560626 4383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:46.559734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:56131)
0808 08:51:46.560245 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:46.560344 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":244,"threads_started":1}
I20260808 08:51:47.020112 4384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:47.019426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:52077)
0808 08:51:47.019832 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:47.019949 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":216,"threads_started":1}
I20260808 08:51:47.101138 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:47.100492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:55027)
0808 08:51:47.100897 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:47.100981 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":207,"threads_started":1}
I20260808 08:51:47.240988 4388 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:47.241158 4388 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:47.241832 4388 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98180ece10aa48009c011609db407677 (127.8.149.67:43767), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
W20260808 08:51:47.242755 3727 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 98180ece10aa48009c011609db407677 (127.8.149.67:43767): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
W20260808 08:51:47.242949 3730 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:47.243105 3730 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c31304ce892462fb08405936e5413e9; no voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90
I20260808 08:51:47.243335 4388 raft_consensus.cc:2726] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:51:47.562224 4389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:47.561531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:33911)
0808 08:51:47.561978 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:47.562061 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":213,"threads_started":1}
I20260808 08:51:48.021646 4390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:48.020980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:57507)
0808 08:51:48.021416 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:48.021487 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":245,"threads_started":1}
I20260808 08:51:48.102623 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:48.101971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:52861)
0808 08:51:48.102376 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:48.102453 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":217,"threads_started":1}
I20260808 08:51:48.563797 4394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:48.563092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:54649)
0808 08:51:48.563560 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:48.563632 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":222,"threads_started":1}
I20260808 08:51:48.843305 4395 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:48.843518 4395 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:48.844295 4395 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98180ece10aa48009c011609db407677 (127.8.149.67:43767), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
W20260808 08:51:48.845438 3730 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
W20260808 08:51:48.845656 3727 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 98180ece10aa48009c011609db407677 (127.8.149.67:43767): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:48.845865 3727 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c31304ce892462fb08405936e5413e9; no voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90
I20260808 08:51:48.846273 4395 raft_consensus.cc:2726] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:51:49.023411 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:49.022641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:57357)
0808 08:51:49.023139 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:49.023213 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":245,"threads_started":1}
I20260808 08:51:49.104234 4397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:49.103457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:44869)
0808 08:51:49.103909 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:49.104017 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":256,"threads_started":1}
I20260808 08:51:49.565464 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:49.564792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:37157)
0808 08:51:49.565220 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:49.565292 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":229,"threads_started":1}
I20260808 08:51:50.025086 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:50.024407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:50483)
0808 08:51:50.024822 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:50.024912 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":211,"threads_started":1}
I20260808 08:51:50.105844 4404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:50.104982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:49691)
0808 08:51:50.105596 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:50.105682 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":331,"threads_started":1}
I20260808 08:51:50.567193 4405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:50.566375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:40587)
0808 08:51:50.566929 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:50.567019 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":268,"threads_started":1}
I20260808 08:51:51.026775 4407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:51.025921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:39261)
0808 08:51:51.026515 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:51.026605 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":229,"threads_started":1}
I20260808 08:51:51.107456 4408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:51.106712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:58687)
0808 08:51:51.107228 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:51.107307 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":288,"threads_started":1}
I20260808 08:51:51.568997 4413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:51.568172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:33197)
0808 08:51:51.568734 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:51.568822 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":386,"threads_started":1}
I20260808 08:51:52.028683 4415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:52.027769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:34529)
0808 08:51:52.028292 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:52.028489 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":249,"threads_started":1}
I20260808 08:51:52.109061 4418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:52.108339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:60991)
0808 08:51:52.108775 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:52.108864 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":221,"threads_started":1}
I20260808 08:51:52.570559 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:52.569891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:51793)
0808 08:51:52.570315 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:52.570421 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":202,"threads_started":1}
I20260808 08:51:53.030352 4423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:53.029638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:33701)
0808 08:51:53.030090 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:53.030167 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":215,"threads_started":1}
I20260808 08:51:53.110528 4429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:53.109807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:36561)
0808 08:51:53.110305 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:53.110380 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":292,"threads_started":1}
I20260808 08:51:53.572228 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:53.571387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:45901)
0808 08:51:53.571891 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:53.571975 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":277,"threads_started":1}
I20260808 08:51:54.031965 4431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:54.031261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:52429)
0808 08:51:54.031714 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:54.031792 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":243,"threads_started":1}
I20260808 08:51:54.112229 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:54.111366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:34267)
0808 08:51:54.111905 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:54.111997 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":284,"threads_started":1}
I20260808 08:51:54.573884 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:54.573173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:36695)
0808 08:51:54.573636 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:54.573724 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":244,"threads_started":1}
I20260808 08:51:55.033586 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:55.032831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:34841)
0808 08:51:55.033329 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:55.033427 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":260,"threads_started":1}
I20260808 08:51:55.113689 4440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:55.113039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:50607)
0808 08:51:55.113432 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:55.113504 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":202,"threads_started":1}
I20260808 08:51:55.575466 4441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:55.574747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:36493)
0808 08:51:55.575186 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:55.575260 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":241,"threads_started":1}
I20260808 08:51:56.035240 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:56.034504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:35905)
0808 08:51:56.034965 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:56.035056 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":225,"threads_started":1}
I20260808 08:51:56.107048 4444 raft_consensus.cc:482] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:51:56.107218 4444 raft_consensus.cc:504] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98180ece10aa48009c011609db407677" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43767 } } peers { permanent_uuid: "2c31304ce892462fb08405936e5413e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 39153 } } peers { permanent_uuid: "ab8478e1d365410899bd841e87674e90" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 40157 } }
I20260808 08:51:56.107875 4444 leader_election.cc:288] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98180ece10aa48009c011609db407677 (127.8.149.67:43767), ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157)
W20260808 08:51:56.108795 3730 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab8478e1d365410899bd841e87674e90 (127.8.149.66:40157): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
W20260808 08:51:56.108987 3727 leader_election.cc:341] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 98180ece10aa48009c011609db407677 (127.8.149.67:43767): Not found: Tablet not found: d11346a6aac440ebafbe9a85e6320bff
I20260808 08:51:56.109128 3727 leader_election.cc:302] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c31304ce892462fb08405936e5413e9; no voters: 98180ece10aa48009c011609db407677, ab8478e1d365410899bd841e87674e90
I20260808 08:51:56.109364 4444 raft_consensus.cc:2726] T d11346a6aac440ebafbe9a85e6320bff P 2c31304ce892462fb08405936e5413e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:51:56.115664 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:56.114723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:40503)
0808 08:51:56.115336 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:56.115459 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":381,"threads_started":1}
I20260808 08:51:56.577236 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:56.576547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.66:40477)
0808 08:51:56.576962 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:56.577089 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":211,"threads_started":1}
I20260808 08:51:57.017541 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 3633
I20260808 08:51:57.033392 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:57.018479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37982 (local address 127.8.149.65:39153)
0808 08:51:57.019199 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:57.019209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:57.019242 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:51:57.019333 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:57.019346 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:57.019661 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:57.019910 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:57.021970 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.022984 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.024410 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.025020 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.025128 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:57.027793 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:57.027803 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:57.027817 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:57.027847 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:57.030787 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.031446 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.031453 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.031455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.031599 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.031962 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.031965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.031967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.032353 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:57.032569 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:57.032801 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 08:51:57.033020 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":379,"threads_started":1}
I20260808 08:51:57.034540 3915 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:57.039969 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:57.036446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.67:57989)
0808 08:51:57.039623 (+ 3177us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:57.039782 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3017,"thread_start_us":2898,"threads_started":1}
I20260808 08:51:57.120548 4451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:57.119595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:46677 (local address 127.8.149.65:45817)
0808 08:51:57.120152 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:57.120286 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.126:46677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":278,"threads_started":1}
I20260808 08:51:57.121173 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 3633
I20260808 08:51:57.145126 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 3929
I20260808 08:51:57.158295 4454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:57.145912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.8.149.66:40157)
0808 08:51:57.146392 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:57.146396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:57.146415 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:51:57.146524 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:57.146531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:57.146620 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:57.146732 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:57.147964 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.148827 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.150162 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.150611 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.150710 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:57.153506 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:57.153511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:57.153514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:57.153543 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:57.156199 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.156742 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.156746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.156748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.156871 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.157170 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.157173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.157175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.157395 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:57.157608 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:57.157777 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 08:51:57.157933 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":245,"threads_started":1}
I20260808 08:51:57.158926 4132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:57.239985 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 3929
I20260808 08:51:57.268406 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 4147
I20260808 08:51:57.281273 4458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:57.269267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52616 (local address 127.8.149.67:43767)
0808 08:51:57.269833 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:57.269838 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:57.269853 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:51:57.269906 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:57.269910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:57.269992 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:57.270079 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:57.271404 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.272255 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.273405 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:57.273805 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:57.273899 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:57.276564 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:57.276568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:57.276571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:57.276598 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:57.278928 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.279553 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.279556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.279559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.279700 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:57.280030 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:57.280033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:57.280035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:57.280318 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:57.280529 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:57.280711 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 08:51:57.280868 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":309,"threads_started":1}
I20260808 08:51:57.282035 4349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:51:57.362196 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 4147
2026-08-08T08:51:57Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64542 ms)
[----------] 30 tests from SecurityITest (303513 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:51:57 dist-test-slave-7vjv krb5kdc[4465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:51:57 dist-test-slave-7vjv krb5kdc[4465](info): set up 2 sockets
Aug 08 08:51:57 dist-test-slave-7vjv krb5kdc[4465](info): commencing operation
krb5kdc: starting...
W20260808 08:51:58.683907 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:51:58 dist-test-slave-7vjv krb5kdc[4465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:51:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:51:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:51:58.946959 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38705
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:38705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:59.268687 4488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:59.268934 4488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:59.269100 4488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:59.275804 4488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:51:59.275893 4488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:59.275985 4488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:59.276085 4488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:51:59.276192 4488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:51:59.285199 4488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:38705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:38705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:59.286336 4488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:59.287602 4488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:59.298605 4496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:59.298703 4500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:59.298732 4498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:59.299263 4488 server_base.cc:1034] running on GCE node
I20260808 08:51:59.300014 4488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:59.301193 4488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:59.302402 4488 hybrid_clock.cc:648] HybridClock initialized: now 1786179119302344 us; error 50 us; skew 500 ppm
I20260808 08:51:59.302671 4488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:59 dist-test-slave-7vjv krb5kdc[4465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179119, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:59.305718 4488 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:51:59.307055 4488 webserver.cc:460] Webserver started at http://127.8.149.126:34959/ using document root <none> and password file <none>
I20260808 08:51:59.307678 4488 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:59.307799 4488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:59.308133 4488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:51:59.310890 4488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "0b8d47dc8a644316aee26faec43d7232"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "30a509cfe55560fadf81f149ad7961ba"
server_key_iv: "55fff3fd815f610c412cf29c824d4444"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.311604 4488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "0b8d47dc8a644316aee26faec43d7232"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "30a509cfe55560fadf81f149ad7961ba"
server_key_iv: "55fff3fd815f610c412cf29c824d4444"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.316195 4488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260808 08:51:59.319406 4511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:59.320662 4488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:51:59.320827 4488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "0b8d47dc8a644316aee26faec43d7232"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "30a509cfe55560fadf81f149ad7961ba"
server_key_iv: "55fff3fd815f610c412cf29c824d4444"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.320998 4488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:59.338325 4488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:59.345852 4488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:59.346129 4488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:59.363528 4488 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:38705
I20260808 08:51:59.363547 4617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:38705 every 8 connection(s)
I20260808 08:51:59.364825 4488 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:51:59.368391 4618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:51:59.369750 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 4488
I20260808 08:51:59.369976 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:51:59.370751 8789 external_mini_cluster.cc:1428] Setting key 1a8f23e5cf7f4ad0f5abdb6387534b90
I20260808 08:51:59.382457 4618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: Bootstrap starting.
Aug 08 08:51:59 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:51:59.385255 4618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: Neither blocks nor log segments found. Creating new log.
I20260808 08:51:59.386430 4618 log.cc:824] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: Log is configured to *not* fsync() on all Append() calls
I20260808 08:51:59.389817 4618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: No bootstrap required, opened a new log
I20260808 08:51:59.394586 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:59.372654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.8.149.126:38705)
0808 08:51:59.373439 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:59.373454 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:59.373510 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:51:59.375059 (+ 1549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:59.375084 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:59.375575 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:59.375982 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:59.377306 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:59.379266 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:59.380659 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:59.381701 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:59.381900 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:51:59.385934 (+ 4034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:51:59.385944 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:51:59.385962 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:51:59.385999 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:51:59.389847 (+ 3848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:59.390598 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:59.390605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:59.390613 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:59.390814 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:51:59.391283 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:51:59.391292 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:51:59.391296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:51:59.391958 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:51:59.392341 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 08:51:59.392943 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 08:51:59.393366 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":347,"threads_started":1}
I20260808 08:51:59.399160 4618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } }
I20260808 08:51:59.399441 4618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:51:59.399507 4618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b8d47dc8a644316aee26faec43d7232, State: Initialized, Role: FOLLOWER
I20260808 08:51:59.400004 4618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } }
I20260808 08:51:59.400255 4618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:51:59.400373 4618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:51:59.400487 4618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:51:59.402300 4618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } }
I20260808 08:51:59.402714 4618 leader_election.cc:302] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b8d47dc8a644316aee26faec43d7232; no voters:
I20260808 08:51:59.403307 4618 leader_election.cc:288] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:51:59.403429 4625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:51:59.404716 4625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [term 1 LEADER]: Becoming Leader. State: Replica: 0b8d47dc8a644316aee26faec43d7232, State: Running, Role: LEADER
I20260808 08:51:59.405192 4625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } }
I20260808 08:51:59.405308 4618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:51:59.408289 4626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b8d47dc8a644316aee26faec43d7232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } } }
I20260808 08:51:59.408643 4626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:59.407895 4629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b8d47dc8a644316aee26faec43d7232. Latest consensus state: current_term: 1 leader_uuid: "0b8d47dc8a644316aee26faec43d7232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b8d47dc8a644316aee26faec43d7232" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 38705 } } }
I20260808 08:51:59.409091 4629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232 [sys.catalog]: This master's current role is: LEADER
I20260808 08:51:59.410933 4637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:51:59.415804 4637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:51:59.423470 4637 catalog_manager.cc:1347] Generated new cluster ID: 14dbbc5f70b242d389fb0aef944b2e22
I20260808 08:51:59.423628 4637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:51:59.436949 4637 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:51:59.438184 4637 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:51:59.446292 4637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: Generated new TSK 0
I20260808 08:51:59.446987 4637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:51:59.531453 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:51:59.870249 4657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:51:59.870584 4657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:51:59.870765 4657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:51:59.877790 4657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:51:59.877909 4657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:51:59.878093 4657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:51:59.887321 4657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:51:59.888614 4657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:51:59.889928 4657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:51:59.902839 4667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:59.902868 4673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:51:59.902782 4670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:51:59.903695 4657 server_base.cc:1034] running on GCE node
I20260808 08:51:59.904327 4657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:51:59.905256 4657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:51:59.906473 4657 hybrid_clock.cc:648] HybridClock initialized: now 1786179119906438 us; error 48 us; skew 500 ppm
I20260808 08:51:59.906770 4657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:51:59 dist-test-slave-7vjv krb5kdc[4465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179119, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:51:59.910109 4657 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:51:59.911473 4657 webserver.cc:460] Webserver started at http://127.8.149.65:34765/ using document root <none> and password file <none>
I20260808 08:51:59.912158 4657 fs_manager.cc:359] Metadata directory not provided
I20260808 08:51:59.912302 4657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:51:59.912621 4657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:51:59.915360 4657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "153e5668821a4e4cae2e78106457922d"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "10227e98459dae14f6444be439cf9866"
server_key_iv: "2ff77412995223f64e3e2930bfff158a"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.916298 4657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "153e5668821a4e4cae2e78106457922d"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "10227e98459dae14f6444be439cf9866"
server_key_iv: "2ff77412995223f64e3e2930bfff158a"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.921756 4657 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:51:59.924985 4690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:59.926280 4657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:51:59.926447 4657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "153e5668821a4e4cae2e78106457922d"
format_stamp: "Formatted at 2026-08-08 08:51:59 on dist-test-slave-7vjv"
server_key: "10227e98459dae14f6444be439cf9866"
server_key_iv: "2ff77412995223f64e3e2930bfff158a"
server_key_version: "encryptionkey@0"
I20260808 08:51:59.926635 4657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:51:59.947860 4657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:51:59.951498 4657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:51:59.951779 4657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:51:59.952726 4657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:51:59.953949 4657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:51:59.954023 4657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:59.954190 4657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:51:59.954246 4657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:51:59.988972 4657 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:38813
I20260808 08:51:59.989061 4879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:38813 every 8 connection(s)
I20260808 08:51:59.990193 4657 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:51:59.996997 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 4657
I20260808 08:51:59.997197 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:51:59.997825 8789 external_mini_cluster.cc:1428] Setting key 3a0854b26fb7843edc6e61ce13e5b24c
Aug 08 08:52:00 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179119, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:00.011096 4883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:59.992638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:43939 (local address 127.8.149.126:38705)
0808 08:51:59.993067 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0808 08:51:59.993071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:51:59.993959 (+ 888us) server_negotiation.cc:407] Connection header received
0808 08:51:59.995714 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:51:59.995719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:51:59.995816 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:51:59.995936 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:51:59.997468 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:51:59.998205 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:51:59.999968 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.000490 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.000630 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:00.004382 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:00.004388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:00.004391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:00.004426 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:00.007370 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:00.008346 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:00.008358 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:00.008361 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:00.008547 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:00.009064 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:00.009070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:00.009074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:00.009408 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:00.009577 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:00.010395 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 08:52:00.010620 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":213,"threads_started":1}
I20260808 08:52:00.012001 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:51:59.993122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38705 (local address 127.8.149.65:43939)
0808 08:51:59.993798 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0808 08:51:59.993843 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:51:59.995436 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:51:59.996204 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:51:59.996211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:51:59.996697 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:51:59.997292 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:59.997315 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:51:59.998347 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:51:59.998352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:51:59.999820 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:51:59.999831 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.000730 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.000740 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:00.000987 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:00.001731 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:00.001756 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:00.004157 (+ 2401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:00.007529 (+ 3372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:00.007538 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:00.007553 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:00.008194 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:00.008675 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:00.008681 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:00.008685 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:00.008945 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:00.009552 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:00.009560 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:00.009944 (+ 384us) client_negotiation.cc:769] Sending connection context
0808 08:52:00.010267 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:52:00.010848 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":277,"threads_started":1}
I20260808 08:52:00.013728 4880 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38705
I20260808 08:52:00.014137 4880 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:00.014997 4880 heartbeater.cc:511] Master 127.8.149.126:38705 requested a full tablet report, sending...
I20260808 08:52:00.017287 4537 ts_manager.cc:194] Registered new tserver with Master: 153e5668821a4e4cae2e78106457922d (127.8.149.65:38813)
I20260808 08:52:00.018803 4537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:43939
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:52:00.065428 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:00.415338 4891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:00.415601 4891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:00.415699 4891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:00.422753 4891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:00.422869 4891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:00.422996 4891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:00.433033 4891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:00.434307 4891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:00.435626 4891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:00.449363 4910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:00.449496 4907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:00.449498 4906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:00.450539 4891 server_base.cc:1034] running on GCE node
I20260808 08:52:00.451251 4891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:00.452275 4891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:00.453507 4891 hybrid_clock.cc:648] HybridClock initialized: now 1786179120453440 us; error 51 us; skew 500 ppm
I20260808 08:52:00.453838 4891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:00 dist-test-slave-7vjv krb5kdc[4465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179120, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:00.457244 4891 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:52:00.458760 4891 webserver.cc:460] Webserver started at http://127.8.149.66:37253/ using document root <none> and password file <none>
I20260808 08:52:00.459501 4891 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:00.459683 4891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:00.460052 4891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:00.463136 4891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "e0925ab6cdb6498e8f96c348db31f9a3"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "8ba9dd1c68c6cf66fe174cf8bf8504a5"
server_key_iv: "4e25fffcd37bd9db32c96e494bc5f7d6"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.463985 4891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "e0925ab6cdb6498e8f96c348db31f9a3"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "8ba9dd1c68c6cf66fe174cf8bf8504a5"
server_key_iv: "4e25fffcd37bd9db32c96e494bc5f7d6"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.469276 4891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 08:52:00.472860 4921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:00.474159 4891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:52:00.474360 4891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "e0925ab6cdb6498e8f96c348db31f9a3"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "8ba9dd1c68c6cf66fe174cf8bf8504a5"
server_key_iv: "4e25fffcd37bd9db32c96e494bc5f7d6"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.474602 4891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:00.486030 4891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:00.490556 4891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:00.490854 4891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:00.491830 4891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:00.493178 4891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:00.493283 4891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:00.493435 4891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:00.493510 4891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:00.528602 4891 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:37863
I20260808 08:52:00.528637 5123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:37863 every 8 connection(s)
I20260808 08:52:00.530171 4891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:00.535583 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 4891
I20260808 08:52:00.535796 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:00.536492 8789 external_mini_cluster.cc:1428] Setting key a183f73642ece54cd43d66d295af2e8f
Aug 08 08:52:00 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179120, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:00.553224 5127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:00.533170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:46023 (local address 127.8.149.126:38705)
0808 08:52:00.533670 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:00.533674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:00.534541 (+ 867us) server_negotiation.cc:407] Connection header received
0808 08:52:00.537025 (+ 2484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:00.537030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:00.537138 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:00.537283 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:00.538985 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.539741 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.542186 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.542623 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.542736 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:00.546905 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:00.546910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:00.546914 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:00.546949 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:00.549756 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:00.550586 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:00.550593 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:00.550598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:00.550742 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:00.551221 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:00.551233 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:00.551236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:00.551537 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:00.551709 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:00.552569 (+ 860us) server_negotiation.cc:299] Negotiation successful
0808 08:52:00.552796 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":268,"threads_started":1}
I20260808 08:52:00.554107 5128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:00.533689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38705 (local address 127.8.149.66:46023)
0808 08:52:00.534368 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:00.534425 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:00.536704 (+ 2279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:00.537533 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:00.537543 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:00.538111 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:00.538798 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:00.538823 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.539894 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.539902 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:00.542017 (+ 2115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:00.542035 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:00.542852 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:00.542861 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:00.543183 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:00.543916 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:00.543948 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:00.546611 (+ 2663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:00.549959 (+ 3348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:00.549968 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:00.549984 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:00.550446 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:00.550876 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:00.550881 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:00.550885 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:00.551085 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:00.551682 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:00.551690 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:00.552086 (+ 396us) client_negotiation.cc:769] Sending connection context
0808 08:52:00.552450 (+ 364us) client_negotiation.cc:240] Negotiation successful
0808 08:52:00.552980 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":279,"threads_started":1}
I20260808 08:52:00.555570 5124 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38705
I20260808 08:52:00.555902 5124 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:00.556766 5124 heartbeater.cc:511] Master 127.8.149.126:38705 requested a full tablet report, sending...
I20260808 08:52:00.558530 4537 ts_manager.cc:194] Registered new tserver with Master: e0925ab6cdb6498e8f96c348db31f9a3 (127.8.149.66:37863)
I20260808 08:52:00.559801 4537 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:46023
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:52:00.607641 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:37059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:00.934580 5131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:00.934806 5131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:00.934885 5131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:00.941716 5131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:00.941809 5131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:00.941922 5131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:00.950493 5131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:37059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:38705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:00.951519 5131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:00.952775 5131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:00.965202 5140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:00.965276 5141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:00.965305 5145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:00.966233 5131 server_base.cc:1034] running on GCE node
I20260808 08:52:00.966812 5131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:00.967767 5131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:00.968999 5131 hybrid_clock.cc:648] HybridClock initialized: now 1786179120968974 us; error 68 us; skew 500 ppm
I20260808 08:52:00.969316 5131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:00 dist-test-slave-7vjv krb5kdc[4465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179120, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:00.972661 5131 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:52:00.974014 5131 webserver.cc:460] Webserver started at http://127.8.149.67:43311/ using document root <none> and password file <none>
I20260808 08:52:00.974660 5131 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:00.974799 5131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:00.975093 5131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:00.977779 5131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "ffc3e2e9daf645bf8cde3a42735cdeea"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "4414c88a407b1a80beb717e0883cb3c2"
server_key_iv: "952008540ca2f185d37b84809009dd6a"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.978619 5131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "ffc3e2e9daf645bf8cde3a42735cdeea"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "4414c88a407b1a80beb717e0883cb3c2"
server_key_iv: "952008540ca2f185d37b84809009dd6a"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.983424 5131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:52:00.986613 5156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:00.987773 5131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:52:00.987968 5131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "ffc3e2e9daf645bf8cde3a42735cdeea"
format_stamp: "Formatted at 2026-08-08 08:52:00 on dist-test-slave-7vjv"
server_key: "4414c88a407b1a80beb717e0883cb3c2"
server_key_iv: "952008540ca2f185d37b84809009dd6a"
server_key_version: "encryptionkey@0"
I20260808 08:52:00.988204 5131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:01.017153 5131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:01.020552 5131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:01.020810 5131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:01.021696 5131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:01.021706 4880 heartbeater.cc:503] Master 127.8.149.126:38705 was elected leader, sending a full tablet report...
I20260808 08:52:01.023057 5131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:01.023124 5131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:01.023237 5131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:01.023315 5131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:01.056085 5131 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:46527
I20260808 08:52:01.056218 5338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:46527 every 8 connection(s)
I20260808 08:52:01.057337 5131 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:01.064270 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 5131
I20260808 08:52:01.064456 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:01.064890 8789 external_mini_cluster.cc:1428] Setting key 6e3ee2a06a5130aa949d3dcaa21699e8
Aug 08 08:52:01 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179120, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:01.077126 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.059851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:55381 (local address 127.8.149.126:38705)
0808 08:52:01.060420 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.060424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.061106 (+ 682us) server_negotiation.cc:407] Connection header received
0808 08:52:01.062943 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.062950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.063041 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.063172 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:01.064766 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.065753 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.067549 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.068065 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.068260 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.071572 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:01.071578 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:01.071582 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:01.071623 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:01.074211 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.074864 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.074869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.074872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.074997 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.075408 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.075412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.075415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.075656 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:01.075817 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.076521 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.076736 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":285,"threads_started":1}
I20260808 08:52:01.078022 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.060245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:38705 (local address 127.8.149.67:55381)
0808 08:52:01.060937 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.060981 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.062642 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.063421 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.063429 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.063909 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:01.064596 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.064617 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.065945 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.065951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.067401 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.067415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.068337 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.068345 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.068565 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.069247 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:01.069268 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:01.071351 (+ 2083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:01.074350 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:01.074358 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:01.074371 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:01.074741 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:01.075105 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:01.075109 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:01.075112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:01.075291 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:01.075786 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:01.075801 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:01.076166 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.076443 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.076914 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":291,"threads_started":1}
I20260808 08:52:01.079537 5342 heartbeater.cc:347] Connected to a master server at 127.8.149.126:38705
I20260808 08:52:01.079856 5342 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:01.080662 5342 heartbeater.cc:511] Master 127.8.149.126:38705 requested a full tablet report, sending...
I20260808 08:52:01.081944 4536 ts_manager.cc:194] Registered new tserver with Master: ffc3e2e9daf645bf8cde3a42735cdeea (127.8.149.67:46527)
I20260808 08:52:01.082816 4536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:55381
I20260808 08:52:01.092247 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:01.108762 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.096955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32912 (local address 127.8.149.126:38705)
0808 08:52:01.097133 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.097137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.097526 (+ 389us) server_negotiation.cc:407] Connection header received
0808 08:52:01.097643 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.097646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.097695 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.097767 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:01.099052 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.099694 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.100958 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.101330 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.101426 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.103550 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:01.103555 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:01.103558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:01.103586 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:01.106145 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.106825 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.106829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.106832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.106966 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.107309 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.107312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.107314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.107718 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:01.107953 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.108248 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.108494 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:52:01.112739 4536 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:01.119346 4536 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:01.141203 5370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.131498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38470 (local address 127.8.149.66:37863)
0808 08:52:01.133193 (+ 1695us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.133200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.133220 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:52:01.133294 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.133299 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.133474 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.133665 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:01.134407 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.135990 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.138899 (+ 2909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.139983 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.140168 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.140388 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.140713 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.140884 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1566,"thread_start_us":1494,"threads_started":1}
I20260808 08:52:01.141337 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.131284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:37863 (local address 127.0.0.1:38470)
0808 08:52:01.132547 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.132592 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.132750 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.133673 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.133680 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.133721 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:01.134177 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.134191 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.136180 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.136186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.138710 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.138728 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.140229 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.140236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.140469 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.140526 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.140674 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.140863 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":2,"thread_start_us":856,"threads_started":1}
I20260808 08:52:01.144418 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.132094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60784 (local address 127.8.149.65:38813)
0808 08:52:01.136005 (+ 3911us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.136012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.136040 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:52:01.136180 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.136188 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.136434 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.136673 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:01.137526 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.139029 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.141869 (+ 2840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.143348 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.143458 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.143700 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.143961 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.144128 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3745,"thread_start_us":3575,"threads_started":1}
I20260808 08:52:01.144445 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.131457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:38813 (local address 127.0.0.1:60784)
0808 08:52:01.135328 (+ 3871us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.135350 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.135472 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.136660 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.136669 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.136708 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:01.137339 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.137354 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.139163 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.139168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.141393 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.141410 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.143602 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.143608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.143776 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.143799 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.143909 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.144025 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3752,"mutex_wait_us":52,"thread_start_us":3623,"threads_started":1}
I20260808 08:52:01.146186 5374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.136517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46527 (local address 127.0.0.1:44606)
0808 08:52:01.137437 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.137645 (+ 208us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.137770 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.138640 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.138649 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.138672 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:01.139020 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.139028 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.141117 (+ 2089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.141123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.143319 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.143335 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.145293 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.145299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.145514 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.145549 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.145689 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.145824 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":4,"thread_start_us":619,"threads_started":1}
I20260808 08:52:01.146248 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.135829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44606 (local address 127.8.149.67:46527)
0808 08:52:01.136533 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.136541 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.137891 (+ 1350us) server_negotiation.cc:407] Connection header received
0808 08:52:01.137988 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.137995 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.138181 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.138364 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:01.139238 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.140952 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.143523 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.144836 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.144963 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.145163 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.145763 (+ 600us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.145932 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":371,"threads_started":1}
I20260808 08:52:01.145614 5012 tablet_service.cc:1467] Processing CreateTablet for tablet f7aad12993a349f0a4c7290fa40dcfba (DEFAULT_TABLE table=test-table [id=2e19a8c79d0546d992e548d21fa3142f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:01.147235 5012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7aad12993a349f0a4c7290fa40dcfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:01.148037 4768 tablet_service.cc:1467] Processing CreateTablet for tablet f7aad12993a349f0a4c7290fa40dcfba (DEFAULT_TABLE table=test-table [id=2e19a8c79d0546d992e548d21fa3142f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:01.149505 4768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7aad12993a349f0a4c7290fa40dcfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:01.149930 5233 tablet_service.cc:1467] Processing CreateTablet for tablet f7aad12993a349f0a4c7290fa40dcfba (DEFAULT_TABLE table=test-table [id=2e19a8c79d0546d992e548d21fa3142f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:01.151252 5233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7aad12993a349f0a4c7290fa40dcfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:01.159477 5375 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Bootstrap starting.
I20260808 08:52:01.163497 5375 tablet_bootstrap.cc:654] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:01.163751 5376 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Bootstrap starting.
I20260808 08:52:01.165117 5375 log.cc:824] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:01.166009 5378 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Bootstrap starting.
I20260808 08:52:01.166925 5376 tablet_bootstrap.cc:654] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:01.168316 5376 log.cc:824] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:01.169589 5375 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: No bootstrap required, opened a new log
I20260808 08:52:01.169582 5378 tablet_bootstrap.cc:654] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:01.169902 5375 ts_tablet_manager.cc:1397] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260808 08:52:01.170672 5378 log.cc:824] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:01.171936 5376 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: No bootstrap required, opened a new log
I20260808 08:52:01.172215 5376 ts_tablet_manager.cc:1397] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260808 08:52:01.173118 5378 tablet_bootstrap.cc:492] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: No bootstrap required, opened a new log
I20260808 08:52:01.173359 5378 ts_tablet_manager.cc:1397] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:52:01.180322 5378 raft_consensus.cc:348] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.180311 5375 raft_consensus.cc:348] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.180644 5378 raft_consensus.cc:374] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:01.180729 5375 raft_consensus.cc:374] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:01.180780 5378 raft_consensus.cc:729] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153e5668821a4e4cae2e78106457922d, State: Initialized, Role: FOLLOWER
I20260808 08:52:01.180847 5375 raft_consensus.cc:729] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0925ab6cdb6498e8f96c348db31f9a3, State: Initialized, Role: FOLLOWER
I20260808 08:52:01.181416 5378 consensus_queue.cc:260] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.181423 5375 consensus_queue.cc:260] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.182974 5378 ts_tablet_manager.cc:1428] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260808 08:52:01.182716 5376 raft_consensus.cc:348] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.183216 5376 raft_consensus.cc:374] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:01.183331 5376 raft_consensus.cc:729] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc3e2e9daf645bf8cde3a42735cdeea, State: Initialized, Role: FOLLOWER
I20260808 08:52:01.184007 5376 consensus_queue.cc:260] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.184770 5124 heartbeater.cc:503] Master 127.8.149.126:38705 was elected leader, sending a full tablet report...
I20260808 08:52:01.185521 5375 ts_tablet_manager.cc:1428] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Time spent starting tablet: real 0.015s user 0.012s sys 0.003s
I20260808 08:52:01.186371 5342 heartbeater.cc:503] Master 127.8.149.126:38705 was elected leader, sending a full tablet report...
I20260808 08:52:01.187076 5376 ts_tablet_manager.cc:1428] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
W20260808 08:52:01.242610 4882 tablet.cc:2369] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:01.282296 5125 tablet.cc:2369] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:01.308871 5346 tablet.cc:2369] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:52:01.367219 5382 raft_consensus.cc:482] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:01.367542 5382 raft_consensus.cc:504] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.369362 5382 leader_election.cc:288] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0925ab6cdb6498e8f96c348db31f9a3 (127.8.149.66:37863), ffc3e2e9daf645bf8cde3a42735cdeea (127.8.149.67:46527)
I20260808 08:52:01.377650 5370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.370055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:57031 (local address 127.8.149.66:37863)
0808 08:52:01.370290 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.370299 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.371035 (+ 736us) server_negotiation.cc:407] Connection header received
0808 08:52:01.371248 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.371254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.371328 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.371436 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:01.372133 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.373210 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.375727 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.376563 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.376743 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.376822 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.377252 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.377398 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:52:01.377754 5388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.369564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:37863 (local address 127.8.149.65:57031)
0808 08:52:01.370906 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.370930 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.371085 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.371469 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.371473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.371501 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:01.371941 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.371958 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.373342 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.373348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.375513 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.375529 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.376776 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.376781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.376996 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.377035 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.377194 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.377331 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1195,"mutex_wait_us":7,"thread_start_us":1135,"threads_started":1}
I20260808 08:52:01.377976 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.369939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:51167 (local address 127.8.149.67:46527)
0808 08:52:01.370175 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.370182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.371029 (+ 847us) server_negotiation.cc:407] Connection header received
0808 08:52:01.371281 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.371285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.371342 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.371448 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:01.372271 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.372969 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.375679 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.376914 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.377069 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.377139 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.377542 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.377683 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:52:01.378778 5387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.370090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:46527 (local address 127.8.149.65:51167)
0808 08:52:01.370938 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:01.370955 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:01.371109 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:01.371617 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:01.371621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:01.371661 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:01.372110 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.372124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.373112 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.373117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.375514 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:01.375529 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.377138 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.377146 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:01.377337 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.377370 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:52:01.378246 (+ 876us) client_negotiation.cc:240] Negotiation successful
0808 08:52:01.378383 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"mutex_wait_us":119,"thread_start_us":436,"threads_started":1}
I20260808 08:52:01.379108 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7aad12993a349f0a4c7290fa40dcfba" candidate_uuid: "153e5668821a4e4cae2e78106457922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" is_pre_election: true
I20260808 08:52:01.379738 5044 raft_consensus.cc:2454] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153e5668821a4e4cae2e78106457922d in term 0.
I20260808 08:52:01.379835 5270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7aad12993a349f0a4c7290fa40dcfba" candidate_uuid: "153e5668821a4e4cae2e78106457922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" is_pre_election: true
I20260808 08:52:01.380442 5270 raft_consensus.cc:2454] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153e5668821a4e4cae2e78106457922d in term 0.
I20260808 08:52:01.380667 4691 leader_election.cc:302] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153e5668821a4e4cae2e78106457922d, e0925ab6cdb6498e8f96c348db31f9a3; no voters:
I20260808 08:52:01.381165 5382 raft_consensus.cc:2781] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:01.381409 5382 raft_consensus.cc:482] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:01.381560 5382 raft_consensus.cc:3037] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:01.384001 5382 raft_consensus.cc:504] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.384763 5382 leader_election.cc:288] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [CANDIDATE]: Term 1 election: Requested vote from peers e0925ab6cdb6498e8f96c348db31f9a3 (127.8.149.66:37863), ffc3e2e9daf645bf8cde3a42735cdeea (127.8.149.67:46527)
I20260808 08:52:01.385190 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7aad12993a349f0a4c7290fa40dcfba" candidate_uuid: "153e5668821a4e4cae2e78106457922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0925ab6cdb6498e8f96c348db31f9a3"
I20260808 08:52:01.385299 5270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7aad12993a349f0a4c7290fa40dcfba" candidate_uuid: "153e5668821a4e4cae2e78106457922d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea"
I20260808 08:52:01.385438 5044 raft_consensus.cc:3037] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:01.385533 5270 raft_consensus.cc:3037] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:01.389204 5270 raft_consensus.cc:2454] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153e5668821a4e4cae2e78106457922d in term 1.
I20260808 08:52:01.389214 5044 raft_consensus.cc:2454] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153e5668821a4e4cae2e78106457922d in term 1.
I20260808 08:52:01.389650 4695 leader_election.cc:302] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153e5668821a4e4cae2e78106457922d, ffc3e2e9daf645bf8cde3a42735cdeea; no voters:
I20260808 08:52:01.389947 5382 raft_consensus.cc:2781] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:01.390388 5382 raft_consensus.cc:686] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 1 LEADER]: Becoming Leader. State: Replica: 153e5668821a4e4cae2e78106457922d, State: Running, Role: LEADER
I20260808 08:52:01.391001 5382 consensus_queue.cc:237] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } }
I20260808 08:52:01.395525 4536 catalog_manager.cc:5495] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d reported cstate change: term changed from 0 to 1, leader changed from <none> to 153e5668821a4e4cae2e78106457922d (127.8.149.65). New cstate: current_term: 1 leader_uuid: "153e5668821a4e4cae2e78106457922d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153e5668821a4e4cae2e78106457922d" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 38813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:01.434056 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.428399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60788 (local address 127.8.149.65:38813)
0808 08:52:01.428605 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.428609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.428653 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:52:01.428845 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.428849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.428924 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.429041 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:01.429386 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.430077 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.431719 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.432218 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.432321 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.432815 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:01.433331 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:01.433479 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.433584 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.433655 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:52:01.442077 5270 raft_consensus.cc:1261] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 1 FOLLOWER]: Refusing update from remote peer 153e5668821a4e4cae2e78106457922d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:01.442181 5044 raft_consensus.cc:1261] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 1 FOLLOWER]: Refusing update from remote peer 153e5668821a4e4cae2e78106457922d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:01.443126 5389 consensus_queue.cc:1035] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0925ab6cdb6498e8f96c348db31f9a3" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 37863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:01.443491 5382 consensus_queue.cc:1035] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc3e2e9daf645bf8cde3a42735cdeea" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:01.455405 5393 mvcc.cc:205] Tried to move back new op lower bound from 7316189681417162752 to 7316189681221091328. Current Snapshot: MvccSnapshot[applied={T|T < 7316189681417162752}]
I20260808 08:52:01.473029 4537 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:01.473300 4537 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:01.476888 4537 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b8d47dc8a644316aee26faec43d7232: Sending DeleteTablet for 3 replicas of tablet f7aad12993a349f0a4c7290fa40dcfba
I20260808 08:52:01.477901 5012 tablet_service.cc:1514] Processing DeleteTablet for tablet f7aad12993a349f0a4c7290fa40dcfba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:01 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:38470
I20260808 08:52:01.478212 4768 tablet_service.cc:1514] Processing DeleteTablet for tablet f7aad12993a349f0a4c7290fa40dcfba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:01 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:60784
I20260808 08:52:01.478935 5233 tablet_service.cc:1514] Processing DeleteTablet for tablet f7aad12993a349f0a4c7290fa40dcfba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:01 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:44606
I20260808 08:52:01.479933 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 4657
I20260808 08:52:01.487064 5413 tablet_replica.cc:330] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: stopping tablet replica
I20260808 08:52:01.487596 5413 raft_consensus.cc:2229] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:01.488209 5413 raft_consensus.cc:2258] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:01.489202 5411 tablet_replica.cc:330] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: stopping tablet replica
I20260808 08:52:01.489670 5411 raft_consensus.cc:2229] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:01.490437 5411 raft_consensus.cc:2258] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:01.493551 5413 ts_tablet_manager.cc:1905] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:01.493999 5411 ts_tablet_manager.cc:1905] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:01.496483 5410 tablet_replica.cc:330] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: stopping tablet replica
I20260808 08:52:01.496929 5410 raft_consensus.cc:2229] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:01.497941 5410 raft_consensus.cc:2258] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:01.500000 5410 ts_tablet_manager.cc:1905] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:01.501184 5413 ts_tablet_manager.cc:1918] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:01.501392 5413 log.cc:1196] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/f7aad12993a349f0a4c7290fa40dcfba
I20260808 08:52:01.501932 5413 ts_tablet_manager.cc:1939] T f7aad12993a349f0a4c7290fa40dcfba P ffc3e2e9daf645bf8cde3a42735cdeea: Deleting consensus metadata
I20260808 08:52:01.502774 5411 ts_tablet_manager.cc:1918] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:01.502985 5411 log.cc:1196] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/f7aad12993a349f0a4c7290fa40dcfba
I20260808 08:52:01.503594 5411 ts_tablet_manager.cc:1939] T f7aad12993a349f0a4c7290fa40dcfba P 153e5668821a4e4cae2e78106457922d: Deleting consensus metadata
Aug 08 08:52:01 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:52:01.503886 4515 catalog_manager.cc:4841] TS ffc3e2e9daf645bf8cde3a42735cdeea (127.8.149.67:46527): tablet f7aad12993a349f0a4c7290fa40dcfba (table test-table [id=2e19a8c79d0546d992e548d21fa3142f]) successfully deleted
I20260808 08:52:01.505442 4515 catalog_manager.cc:4841] TS 153e5668821a4e4cae2e78106457922d (127.8.149.65:38813): tablet f7aad12993a349f0a4c7290fa40dcfba (table test-table [id=2e19a8c79d0546d992e548d21fa3142f]) successfully deleted
I20260808 08:52:01.510850 5410 ts_tablet_manager.cc:1918] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:01.511052 5410 log.cc:1196] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/f7aad12993a349f0a4c7290fa40dcfba
I20260808 08:52:01.511572 5410 ts_tablet_manager.cc:1939] T f7aad12993a349f0a4c7290fa40dcfba P e0925ab6cdb6498e8f96c348db31f9a3: Deleting consensus metadata
I20260808 08:52:01.513101 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.481457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60792 (local address 127.8.149.65:38813)
0808 08:52:01.481633 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.481639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.486806 (+ 5167us) server_negotiation.cc:407] Connection header received
0808 08:52:01.487018 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.487024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.487134 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.487238 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:01.490944 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.492150 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.494272 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.495068 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.495174 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.505066 (+ 9892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:01.505084 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:01.505101 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:01.505153 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:01.509686 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.510613 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.510621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.510625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.510807 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.511293 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.511298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.511302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.511771 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:01.512058 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.512495 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.512725 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:52:01.513506 4512 catalog_manager.cc:4841] TS e0925ab6cdb6498e8f96c348db31f9a3 (127.8.149.66:37863): tablet f7aad12993a349f0a4c7290fa40dcfba (table test-table [id=2e19a8c79d0546d992e548d21fa3142f]) successfully deleted
I20260808 08:52:01.513826 4872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:01.611620 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 4657
I20260808 08:52:01.640981 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 4891
Aug 08 08:52:01 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:52:01.656654 5370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.641764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38478 (local address 127.8.149.66:37863)
0808 08:52:01.641949 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.641955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.642137 (+ 182us) server_negotiation.cc:407] Connection header received
0808 08:52:01.642350 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.642355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.642438 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.642547 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:01.643841 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.644646 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.645943 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.646333 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.646476 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.650649 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:01.650663 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:01.650679 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:01.650718 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:01.653899 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.654546 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.654553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.654556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.654685 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.655058 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.655062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.655064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.655491 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:01.655732 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.656013 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.656382 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:52:01.657284 5118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:01.745160 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 4891
I20260808 08:52:01.769748 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 5131
Aug 08 08:52:01 dist-test-slave-7vjv krb5kdc[4465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:52:01.786746 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:01.770756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.8.149.67:46527)
0808 08:52:01.770972 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:01.770981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:01.771004 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:52:01.771235 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:01.771240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:01.771322 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:01.771444 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:01.772888 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.773617 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.774945 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:01.775373 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:01.775515 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:01.780563 (+ 5048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:01.780579 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:01.780596 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:01.780637 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:01.783624 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.784500 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.784508 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.784510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.784657 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:01.785111 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:01.785116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:01.785118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:01.785486 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:01.785805 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:01.786109 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 08:52:01.786378 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 08:52:01.787513 5331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:01.873756 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 5131
I20260808 08:52:01.898923 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 4488
I20260808 08:52:01.900152 4608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:02.005504 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 4488
2026-08-08T08:52:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4646 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T08:52:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:02Z Disabled control of system clock
I20260808 08:52:02.098843 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41655
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:41655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:02.438454 5428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:02.438743 5428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:02.438943 5428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:02.445967 5428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:02.446070 5428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:02.446177 5428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:02.446297 5428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:02.446389 5428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:02.455296 5428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:41655
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:41655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:02.456596 5428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:02.458564 5428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:02.470873 5438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:02.470943 5437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:02.470983 5440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:02.471918 5428 server_base.cc:1034] running on GCE node
I20260808 08:52:02.472765 5428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:02.474141 5428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:02.475358 5428 hybrid_clock.cc:648] HybridClock initialized: now 1786179122475305 us; error 39 us; skew 500 ppm
I20260808 08:52:02.475726 5428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:02.477911 5428 webserver.cc:460] Webserver started at http://127.8.149.126:34501/ using document root <none> and password file <none>
I20260808 08:52:02.478631 5428 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:02.478719 5428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:02.479065 5428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:02.481871 5428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "3bdb61bdf28c46649393ce260ed4fd88"
format_stamp: "Formatted at 2026-08-08 08:52:02 on dist-test-slave-7vjv"
server_key: "829ccacf3166d1adeca553f7acd9f47a"
server_key_iv: "0866c44411b25f0aa2f143c269df069d"
server_key_version: "encryptionkey@0"
I20260808 08:52:02.482664 5428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "3bdb61bdf28c46649393ce260ed4fd88"
format_stamp: "Formatted at 2026-08-08 08:52:02 on dist-test-slave-7vjv"
server_key: "829ccacf3166d1adeca553f7acd9f47a"
server_key_iv: "0866c44411b25f0aa2f143c269df069d"
server_key_version: "encryptionkey@0"
I20260808 08:52:02.487458 5428 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:52:02.490787 5448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:02.491963 5428 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:52:02.492167 5428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "3bdb61bdf28c46649393ce260ed4fd88"
format_stamp: "Formatted at 2026-08-08 08:52:02 on dist-test-slave-7vjv"
server_key: "829ccacf3166d1adeca553f7acd9f47a"
server_key_iv: "0866c44411b25f0aa2f143c269df069d"
server_key_version: "encryptionkey@0"
I20260808 08:52:02.492377 5428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:02.517553 5428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:02.518260 5428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:02.518541 5428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:02.536820 5428 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:41655
I20260808 08:52:02.536849 5539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:41655 every 8 connection(s)
I20260808 08:52:02.538008 5428 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:02.540829 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 5428
I20260808 08:52:02.541046 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:02.541641 8789 external_mini_cluster.cc:1428] Setting key a8b6e0e51b4cfb87c68f79dd86f3de50
I20260808 08:52:02.542186 5541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:02.556995 5541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: Bootstrap starting.
I20260808 08:52:02.557051 5545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:02.543792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.8.149.126:41655)
0808 08:52:02.544955 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:02.544967 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:02.545014 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:52:02.547112 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:02.547140 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:02.547678 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:02.548060 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:02.548569 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:02.550615 (+ 2046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:02.552072 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:02.553056 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:02.553233 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:02.554437 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:02.554449 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:02.554474 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:02.555165 (+ 691us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:02.555253 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:02.555276 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:02.555390 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:02.555602 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 08:52:02.555883 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":458,"threads_started":1}
I20260808 08:52:02.560240 5541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:02.561122 5541 log.cc:824] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:02.563709 5541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: No bootstrap required, opened a new log
I20260808 08:52:02.570458 5541 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } }
I20260808 08:52:02.570734 5541 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:02.570801 5541 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bdb61bdf28c46649393ce260ed4fd88, State: Initialized, Role: FOLLOWER
I20260808 08:52:02.571251 5541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } }
I20260808 08:52:02.571447 5541 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:02.571542 5541 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:02.571658 5541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:02.573650 5541 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } }
I20260808 08:52:02.574077 5541 leader_election.cc:302] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bdb61bdf28c46649393ce260ed4fd88; no voters:
I20260808 08:52:02.574621 5541 leader_election.cc:288] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:02.574720 5547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:02.575558 5547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [term 1 LEADER]: Becoming Leader. State: Replica: 3bdb61bdf28c46649393ce260ed4fd88, State: Running, Role: LEADER
I20260808 08:52:02.576196 5547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } }
I20260808 08:52:02.576792 5541 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:02.578949 5549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bdb61bdf28c46649393ce260ed4fd88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } } }
I20260808 08:52:02.578871 5548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bdb61bdf28c46649393ce260ed4fd88. Latest consensus state: current_term: 1 leader_uuid: "3bdb61bdf28c46649393ce260ed4fd88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bdb61bdf28c46649393ce260ed4fd88" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 41655 } } }
I20260808 08:52:02.579418 5549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:02.579460 5548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:02.582289 5562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:02.587268 5562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:02.596344 5562 catalog_manager.cc:1347] Generated new cluster ID: 4e90e447ef924a11b234d1c2a1ba79c7
I20260808 08:52:02.596511 5562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:02.629155 5562 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:02.630384 5562 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:02.639418 5562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: Generated new TSK 0
I20260808 08:52:02.640200 5562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:02.659139 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--builtin_ntp_servers=127.8.149.84:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:02.995707 5577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:02.995965 5577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:02.996052 5577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:03.002779 5577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:03.002871 5577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:03.002974 5577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:52:03.011475 5577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:03.012588 5577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:03.014281 5577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:03.026620 5592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.026713 5585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.026669 5589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:03.027431 5577 server_base.cc:1034] running on GCE node
I20260808 08:52:03.027985 5577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:03.028923 5577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:03.030145 5577 hybrid_clock.cc:648] HybridClock initialized: now 1786179123030060 us; error 72 us; skew 500 ppm
I20260808 08:52:03.030453 5577 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:03.032786 5577 webserver.cc:460] Webserver started at http://127.8.149.65:35429/ using document root <none> and password file <none>
I20260808 08:52:03.033435 5577 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:03.033566 5577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:03.033879 5577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:03.036608 5577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "09f2e67b53c246168bfd9ec880b040e9"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "77b1919a5d95a5f1e39c601a4b53b667"
server_key_iv: "dd8fe100fbc5feb5a99b7f1fe5a180e4"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.037400 5577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "09f2e67b53c246168bfd9ec880b040e9"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "77b1919a5d95a5f1e39c601a4b53b667"
server_key_iv: "dd8fe100fbc5feb5a99b7f1fe5a180e4"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.042270 5577 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:52:03.045565 5602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.046742 5577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:52:03.046926 5577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "09f2e67b53c246168bfd9ec880b040e9"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "77b1919a5d95a5f1e39c601a4b53b667"
server_key_iv: "dd8fe100fbc5feb5a99b7f1fe5a180e4"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.047138 5577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:03.063665 5577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:03.064678 5577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:03.065062 5577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:03.066113 5577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:03.067508 5577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:03.067631 5577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.067767 5577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:03.067902 5577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.102025 5577 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:44989
I20260808 08:52:03.102098 5779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:44989 every 8 connection(s)
I20260808 08:52:03.103229 5577 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:52:03.110239 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 5577
I20260808 08:52:03.110412 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:52:03.110883 8789 external_mini_cluster.cc:1428] Setting key 5d9bbbb077bf8fdbc9b64a3061799c4d
I20260808 08:52:03.113528 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--builtin_ntp_servers=127.8.149.84:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:03.115212 5787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:03.105631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:54239 (local address 127.8.149.126:41655)
0808 08:52:03.106046 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:03.106050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:03.106994 (+ 944us) server_negotiation.cc:407] Connection header received
0808 08:52:03.108791 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:03.108797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:03.108893 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:03.109013 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:03.110090 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.110954 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.112546 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.112945 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.113069 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:03.114333 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:03.114338 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:03.114348 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:03.114365 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:03.114402 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:03.114413 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:03.114504 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:03.114776 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 08:52:03.114868 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":234,"threads_started":1}
I20260808 08:52:03.116050 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:03.106052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41655 (local address 127.8.149.65:54239)
0808 08:52:03.106841 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:03.106884 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:03.108535 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:03.109233 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:03.109241 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:03.109317 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:03.109875 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:03.109921 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.111126 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.111130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:03.112397 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:03.112410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.113164 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.113171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:03.113372 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:03.114052 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:03.114054 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:03.114087 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:03.114155 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:03.114505 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:03.114517 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:03.114527 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:52:03.114761 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 08:52:03.115111 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":265,"threads_started":1}
I20260808 08:52:03.117640 5782 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41655
I20260808 08:52:03.117925 5782 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:03.118583 5782 heartbeater.cc:511] Master 127.8.149.126:41655 requested a full tablet report, sending...
I20260808 08:52:03.120740 5480 ts_manager.cc:194] Registered new tserver with Master: 09f2e67b53c246168bfd9ec880b040e9 (127.8.149.65:44989)
I20260808 08:52:03.122714 5480 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.65:54239
W20260808 08:52:03.454059 5789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:03.454300 5789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:03.454460 5789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:03.461691 5789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:03.461786 5789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:03.461995 5789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:03.471374 5789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:03.472746 5789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:03.474587 5789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:03.491516 5795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.492259 5800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.492221 5796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:03.492784 5789 server_base.cc:1034] running on GCE node
I20260808 08:52:03.493989 5789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:03.494947 5789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:03.496205 5789 hybrid_clock.cc:648] HybridClock initialized: now 1786179123496138 us; error 51 us; skew 500 ppm
I20260808 08:52:03.496580 5789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:03.498872 5789 webserver.cc:460] Webserver started at http://127.8.149.66:45703/ using document root <none> and password file <none>
I20260808 08:52:03.499533 5789 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:03.499662 5789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:03.499974 5789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:03.502820 5789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "88adc0ae59614c1f8b02624fd30a5cb4"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "07d29863b309e932b1dec4c7bfdd2081"
server_key_iv: "da2821765811dac45cefd116bd55b097"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.503559 5789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "88adc0ae59614c1f8b02624fd30a5cb4"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "07d29863b309e932b1dec4c7bfdd2081"
server_key_iv: "da2821765811dac45cefd116bd55b097"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.508586 5789 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 08:52:03.512056 5811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.513509 5789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:52:03.513680 5789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "88adc0ae59614c1f8b02624fd30a5cb4"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "07d29863b309e932b1dec4c7bfdd2081"
server_key_iv: "da2821765811dac45cefd116bd55b097"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.513872 5789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:03.535579 5789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:03.536512 5789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:03.536854 5789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:03.537914 5789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:03.539646 5789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:03.539762 5789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.539881 5789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:03.539980 5789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.582203 5789 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:41889
I20260808 08:52:03.582273 5991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:41889 every 8 connection(s)
I20260808 08:52:03.583531 5789 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:03.584230 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 5789
I20260808 08:52:03.584429 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:03.585183 8789 external_mini_cluster.cc:1428] Setting key 2df8b2499923c3189bf4eeed95f70aab
I20260808 08:52:03.589964 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--builtin_ntp_servers=127.8.149.84:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:03.603152 5787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:03.587545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:39005 (local address 127.8.149.126:41655)
0808 08:52:03.587760 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:03.587768 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:03.593133 (+ 5365us) server_negotiation.cc:407] Connection header received
0808 08:52:03.595854 (+ 2721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:03.595860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:03.595939 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:03.596044 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:03.597432 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.598059 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.600476 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.600836 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.600936 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:03.602490 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:03.602494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:03.602497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:03.602514 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:03.602542 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:03.602553 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:03.602615 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:03.602860 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 08:52:03.602931 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:52:03.604319 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:03.587304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41655 (local address 127.8.149.66:39005)
0808 08:52:03.592978 (+ 5674us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:03.593026 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:03.595576 (+ 2550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:03.596357 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:03.596370 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:03.596489 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:03.597251 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:03.597274 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.598207 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.598214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:03.600323 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:03.600339 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:03.601071 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:03.601080 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:03.601435 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:03.602128 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:03.602134 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:03.602190 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:03.602286 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:03.602645 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:03.602658 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:03.602668 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:52:03.602831 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 08:52:03.603203 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5115,"thread_start_us":4870,"threads_started":1}
I20260808 08:52:03.605690 5994 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41655
I20260808 08:52:03.606002 5994 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:03.606648 5994 heartbeater.cc:511] Master 127.8.149.126:41655 requested a full tablet report, sending...
I20260808 08:52:03.607959 5480 ts_manager.cc:194] Registered new tserver with Master: 88adc0ae59614c1f8b02624fd30a5cb4 (127.8.149.66:41889)
I20260808 08:52:03.608759 5480 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.66:39005
W20260808 08:52:03.915693 5998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:03.915992 5998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:03.916188 5998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:03.923039 5998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:03.923157 5998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:03.923354 5998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:03.931270 5998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:41655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:03.932370 5998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:03.934052 5998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:03.946673 6008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.946712 6010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:03.946744 6006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:03.947680 5998 server_base.cc:1034] running on GCE node
I20260808 08:52:03.948437 5998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:03.949318 5998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:03.950556 5998 hybrid_clock.cc:648] HybridClock initialized: now 1786179123950521 us; error 48 us; skew 500 ppm
I20260808 08:52:03.950953 5998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:03.953315 5998 webserver.cc:460] Webserver started at http://127.8.149.67:41345/ using document root <none> and password file <none>
I20260808 08:52:03.953998 5998 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:03.954128 5998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:03.954435 5998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:03.957115 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "731a645527464f7ba6e4d38e4cd3c2ce"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "e492c97c9b18c07fb558fb67fc75f1de"
server_key_iv: "3435d1c179b6c01a2fa6dd8e27e1a58b"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.957878 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "731a645527464f7ba6e4d38e4cd3c2ce"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "e492c97c9b18c07fb558fb67fc75f1de"
server_key_iv: "3435d1c179b6c01a2fa6dd8e27e1a58b"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.962693 5998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 08:52:03.966104 6020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.967326 5998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:52:03.967500 5998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "731a645527464f7ba6e4d38e4cd3c2ce"
format_stamp: "Formatted at 2026-08-08 08:52:03 on dist-test-slave-7vjv"
server_key: "e492c97c9b18c07fb558fb67fc75f1de"
server_key_iv: "3435d1c179b6c01a2fa6dd8e27e1a58b"
server_key_version: "encryptionkey@0"
I20260808 08:52:03.967712 5998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:03.989880 5998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:03.990607 5998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:03.990922 5998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:03.991811 5998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:03.993319 5998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:03.993438 5998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:03.993580 5998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:03.993664 5998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:04.026523 5998 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:38853
I20260808 08:52:04.026605 6206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:38853 every 8 connection(s)
I20260808 08:52:04.027750 5998 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:04.031564 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 5998
I20260808 08:52:04.031769 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:04.032420 8789 external_mini_cluster.cc:1428] Setting key ceb8e356b132ea559f72d14dd65fdbf4
I20260808 08:52:04.039906 5787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.030141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:56845 (local address 127.8.149.126:41655)
0808 08:52:04.030311 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.030316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.031799 (+ 1483us) server_negotiation.cc:407] Connection header received
0808 08:52:04.034084 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.034089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.034176 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.034272 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:04.035389 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.036291 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.037678 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.038068 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.038160 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.039233 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:04.039238 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:04.039241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:04.039257 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:04.039286 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:04.039297 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:04.039400 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.039577 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.039656 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:52:04.040896 6212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.030556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:41655 (local address 127.8.149.67:56845)
0808 08:52:04.031610 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.031658 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.033790 (+ 2132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.034508 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.034515 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.034601 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:04.035227 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.035251 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.036425 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.036428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.037553 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.037564 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.038240 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.038244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.038423 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.038973 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:04.038975 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:04.039016 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:04.039080 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:04.039409 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:04.039416 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:04.039422 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.039549 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.039815 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":304,"threads_started":1}
I20260808 08:52:04.042188 6210 heartbeater.cc:347] Connected to a master server at 127.8.149.126:41655
I20260808 08:52:04.042484 6210 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:04.043207 6210 heartbeater.cc:511] Master 127.8.149.126:41655 requested a full tablet report, sending...
I20260808 08:52:04.044639 5480 ts_manager.cc:194] Registered new tserver with Master: 731a645527464f7ba6e4d38e4cd3c2ce (127.8.149.67:38853)
I20260808 08:52:04.045450 5480 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.67:56845
I20260808 08:52:04.047446 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:04.057301 5787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.051716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39934 (local address 127.8.149.126:41655)
0808 08:52:04.051930 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.051938 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.052373 (+ 435us) server_negotiation.cc:407] Connection header received
0808 08:52:04.052490 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.052495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.052574 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.052650 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:04.053094 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.053786 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.055085 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.055441 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.055530 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.056603 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:04.056608 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:04.056611 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:04.056627 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:04.056655 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:04.056667 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:04.056736 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.056896 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.056957 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:52:04.060747 5480 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:04.067373 5480 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:04.104542 6227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.079398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56200)
0808 08:52:04.096236 (+ 16838us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.096254 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.096378 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.097083 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.097091 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.097123 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:04.097629 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.097643 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.099455 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.099460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.101321 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.101334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.103565 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.103572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.103771 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.103823 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.103943 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.104119 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16667,"mutex_wait_us":6,"thread_start_us":16506,"threads_started":1}
I20260808 08:52:04.104801 6234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.079106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:41889 (local address 127.0.0.1:51536)
0808 08:52:04.089523 (+ 10417us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.089573 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.089793 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.095531 (+ 5738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.095538 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.095577 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:04.095987 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.096002 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.098485 (+ 2483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.098490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.100812 (+ 2322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.100823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.103877 (+ 3054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.103883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.104040 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.104071 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.104168 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.104286 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10088,"mutex_wait_us":26,"thread_start_us":17981,"threads_started":1}
I20260808 08:52:04.105655 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.079483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.8.149.66:41889)
0808 08:52:04.094688 (+ 15205us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.094699 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.094735 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:52:04.094843 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.094852 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.095105 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.095525 (+ 420us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:04.096249 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.098309 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.100997 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.103393 (+ 2396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.103510 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.103751 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.105159 (+ 1408us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.105325 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15004,"thread_start_us":15765,"threads_started":1}
I20260808 08:52:04.105707 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.080235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.8.149.65:44989)
0808 08:52:04.095120 (+ 14885us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.095128 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.096372 (+ 1244us) server_negotiation.cc:407] Connection header received
0808 08:52:04.096534 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.096544 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.096781 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.097841 (+ 1060us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:04.098118 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.099331 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.101560 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.103064 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.103196 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.103441 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.105091 (+ 1650us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.105295 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14722,"thread_start_us":14878,"threads_started":1}
I20260808 08:52:04.106138 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.081775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:38853 (local address 127.0.0.1:50900)
0808 08:52:04.097386 (+ 15611us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.097412 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.097589 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.098293 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.098296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.098320 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:04.098791 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.098805 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.100689 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.100695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.102694 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.102716 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.105179 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.105186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.105468 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.105505 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.105599 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.105731 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15477,"mutex_wait_us":56,"thread_start_us":7231,"threads_started":1}
I20260808 08:52:04.106894 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.082386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50900 (local address 127.8.149.67:38853)
0808 08:52:04.096951 (+ 14565us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.096959 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.097492 (+ 533us) server_negotiation.cc:407] Connection header received
0808 08:52:04.097751 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.097758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.097943 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.098070 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:04.098992 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.100537 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.102942 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.104257 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.104348 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.104999 (+ 651us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.106417 (+ 1418us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.106571 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14404,"thread_start_us":14245,"threads_started":1}
I20260808 08:52:04.109583 5680 tablet_service.cc:1467] Processing CreateTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 (DEFAULT_TABLE table=test-table [id=41625b31d20f481fa239c352efc86ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:04.110744 5680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d5a765b2334a56a08c0ebe07b22091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:04.110301 6091 tablet_service.cc:1467] Processing CreateTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 (DEFAULT_TABLE table=test-table [id=41625b31d20f481fa239c352efc86ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:04.110307 5884 tablet_service.cc:1467] Processing CreateTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 (DEFAULT_TABLE table=test-table [id=41625b31d20f481fa239c352efc86ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:04.111615 6091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d5a765b2334a56a08c0ebe07b22091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:04.111615 5884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32d5a765b2334a56a08c0ebe07b22091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:04.121502 6238 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Bootstrap starting.
I20260808 08:52:04.124289 6238 tablet_bootstrap.cc:654] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:04.125087 6239 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Bootstrap starting.
I20260808 08:52:04.125284 5782 heartbeater.cc:503] Master 127.8.149.126:41655 was elected leader, sending a full tablet report...
I20260808 08:52:04.126049 6242 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Bootstrap starting.
I20260808 08:52:04.127650 6238 log.cc:824] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:04.128616 6239 tablet_bootstrap.cc:654] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:04.129868 6242 tablet_bootstrap.cc:654] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:04.130082 6239 log.cc:824] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:04.130968 6242 log.cc:824] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:04.132966 6238 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: No bootstrap required, opened a new log
I20260808 08:52:04.132982 6239 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: No bootstrap required, opened a new log
I20260808 08:52:04.133247 6239 ts_tablet_manager.cc:1397] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260808 08:52:04.133255 6238 ts_tablet_manager.cc:1397] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260808 08:52:04.135253 6242 tablet_bootstrap.cc:492] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: No bootstrap required, opened a new log
I20260808 08:52:04.135517 6242 ts_tablet_manager.cc:1397] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260808 08:52:04.140426 6238 raft_consensus.cc:348] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.140847 6238 raft_consensus.cc:374] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:04.140945 6238 raft_consensus.cc:729] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09f2e67b53c246168bfd9ec880b040e9, State: Initialized, Role: FOLLOWER
I20260808 08:52:04.141628 6238 consensus_queue.cc:260] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.143169 6238 ts_tablet_manager.cc:1428] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Time spent starting tablet: real 0.010s user 0.007s sys 0.002s
I20260808 08:52:04.143956 6239 raft_consensus.cc:348] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.144352 6239 raft_consensus.cc:374] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:04.144445 6239 raft_consensus.cc:729] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88adc0ae59614c1f8b02624fd30a5cb4, State: Initialized, Role: FOLLOWER
I20260808 08:52:04.144975 6239 consensus_queue.cc:260] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.145969 5994 heartbeater.cc:503] Master 127.8.149.126:41655 was elected leader, sending a full tablet report...
I20260808 08:52:04.146571 6239 ts_tablet_manager.cc:1428] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260808 08:52:04.145555 6242 raft_consensus.cc:348] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.147187 6242 raft_consensus.cc:374] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:04.147282 6242 raft_consensus.cc:729] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731a645527464f7ba6e4d38e4cd3c2ce, State: Initialized, Role: FOLLOWER
I20260808 08:52:04.147799 6242 consensus_queue.cc:260] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.148799 6210 heartbeater.cc:503] Master 127.8.149.126:41655 was elected leader, sending a full tablet report...
I20260808 08:52:04.149448 6242 ts_tablet_manager.cc:1428] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20260808 08:52:04.189007 6249 raft_consensus.cc:482] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:04.189232 6249 raft_consensus.cc:504] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.191008 6249 leader_election.cc:288] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88adc0ae59614c1f8b02624fd30a5cb4 (127.8.149.66:41889), 731a645527464f7ba6e4d38e4cd3c2ce (127.8.149.67:38853)
I20260808 08:52:04.199635 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.191669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:33621 (local address 127.8.149.67:38853)
0808 08:52:04.191835 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.191842 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.192492 (+ 650us) server_negotiation.cc:407] Connection header received
0808 08:52:04.192630 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.192636 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.192702 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.192789 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:04.193527 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.194556 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.197381 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.198583 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.198713 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.198768 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.199219 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.199356 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 08:52:04.199637 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.191247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:56971 (local address 127.8.149.66:41889)
0808 08:52:04.191454 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.191464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.192180 (+ 716us) server_negotiation.cc:407] Connection header received
0808 08:52:04.192427 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.192431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.192536 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.192648 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:04.193338 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.194435 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.197363 (+ 2928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.198533 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.198701 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.198769 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.199225 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.199367 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:52:04.199712 6255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.191474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:38853 (local address 127.8.149.65:33621)
0808 08:52:04.192391 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.192408 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.192515 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.192837 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.192841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.192872 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:04.193365 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.193375 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.194678 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.194684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.197150 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.197166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.198760 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.198768 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.198940 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.199039 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.199129 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.199309 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":224,"thread_start_us":568,"threads_started":1}
I20260808 08:52:04.199754 6252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.191122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:41889 (local address 127.8.149.65:56971)
0808 08:52:04.192051 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.192066 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:04.192274 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:04.192661 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:04.192664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:04.192681 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:04.193185 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.193200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.194572 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.194575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.197158 (+ 2583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:04.197166 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.198805 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.198811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:04.198987 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.199033 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:52:04.199129 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 08:52:04.199309 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":184,"thread_start_us":721,"threads_started":1}
I20260808 08:52:04.200776 5915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32d5a765b2334a56a08c0ebe07b22091" candidate_uuid: "09f2e67b53c246168bfd9ec880b040e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" is_pre_election: true
I20260808 08:52:04.201201 6132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32d5a765b2334a56a08c0ebe07b22091" candidate_uuid: "09f2e67b53c246168bfd9ec880b040e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" is_pre_election: true
I20260808 08:52:04.201346 5915 raft_consensus.cc:2454] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f2e67b53c246168bfd9ec880b040e9 in term 0.
I20260808 08:52:04.201716 6132 raft_consensus.cc:2454] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f2e67b53c246168bfd9ec880b040e9 in term 0.
I20260808 08:52:04.202032 5605 leader_election.cc:302] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f2e67b53c246168bfd9ec880b040e9, 88adc0ae59614c1f8b02624fd30a5cb4; no voters:
I20260808 08:52:04.202517 6249 raft_consensus.cc:2781] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:04.202682 6249 raft_consensus.cc:482] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:04.202803 6249 raft_consensus.cc:3037] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:04.205168 6249 raft_consensus.cc:504] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.205796 6249 leader_election.cc:288] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [CANDIDATE]: Term 1 election: Requested vote from peers 88adc0ae59614c1f8b02624fd30a5cb4 (127.8.149.66:41889), 731a645527464f7ba6e4d38e4cd3c2ce (127.8.149.67:38853)
I20260808 08:52:04.206182 5915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32d5a765b2334a56a08c0ebe07b22091" candidate_uuid: "09f2e67b53c246168bfd9ec880b040e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88adc0ae59614c1f8b02624fd30a5cb4"
I20260808 08:52:04.206266 6132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32d5a765b2334a56a08c0ebe07b22091" candidate_uuid: "09f2e67b53c246168bfd9ec880b040e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "731a645527464f7ba6e4d38e4cd3c2ce"
I20260808 08:52:04.206382 5915 raft_consensus.cc:3037] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:04.206426 6132 raft_consensus.cc:3037] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:04.209461 5915 raft_consensus.cc:2454] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f2e67b53c246168bfd9ec880b040e9 in term 1.
I20260808 08:52:04.209457 6132 raft_consensus.cc:2454] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f2e67b53c246168bfd9ec880b040e9 in term 1.
I20260808 08:52:04.209895 5604 leader_election.cc:302] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f2e67b53c246168bfd9ec880b040e9, 731a645527464f7ba6e4d38e4cd3c2ce; no voters:
I20260808 08:52:04.210268 6249 raft_consensus.cc:2781] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:04.210825 6249 raft_consensus.cc:686] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 1 LEADER]: Becoming Leader. State: Replica: 09f2e67b53c246168bfd9ec880b040e9, State: Running, Role: LEADER
I20260808 08:52:04.211407 6249 consensus_queue.cc:237] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } }
I20260808 08:52:04.215940 5480 catalog_manager.cc:5495] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09f2e67b53c246168bfd9ec880b040e9 (127.8.149.65). New cstate: current_term: 1 leader_uuid: "09f2e67b53c246168bfd9ec880b040e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f2e67b53c246168bfd9ec880b040e9" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:04.252243 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.246755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.8.149.65:44989)
0808 08:52:04.246985 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.246989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.247006 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:52:04.247170 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.247173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.247259 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.247396 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:04.247710 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.248475 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.249932 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.250466 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.250562 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.251074 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:04.251609 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:04.251715 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.251811 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.251919 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:52:04.260555 6132 raft_consensus.cc:1261] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 1 FOLLOWER]: Refusing update from remote peer 09f2e67b53c246168bfd9ec880b040e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:04.260555 5915 raft_consensus.cc:1261] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 1 FOLLOWER]: Refusing update from remote peer 09f2e67b53c246168bfd9ec880b040e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:04.261772 6257 consensus_queue.cc:1035] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "731a645527464f7ba6e4d38e4cd3c2ce" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:04.262189 6249 consensus_queue.cc:1035] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88adc0ae59614c1f8b02624fd30a5cb4" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:04.272337 6264 mvcc.cc:205] Tried to move back new op lower bound from 7316189692960108544 to 7316189692774035456. Current Snapshot: MvccSnapshot[applied={T|T < 7316189692960108544}]
I20260808 08:52:04.284257 6265 mvcc.cc:205] Tried to move back new op lower bound from 7316189692960108544 to 7316189692774035456. Current Snapshot: MvccSnapshot[applied={T|T < 7316189692960108544 or (T in {7316189692960108544})}]
I20260808 08:52:04.286145 5479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:04.286437 5479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:04.290120 5479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3bdb61bdf28c46649393ce260ed4fd88: Sending DeleteTablet for 3 replicas of tablet 32d5a765b2334a56a08c0ebe07b22091
I20260808 08:52:04.291198 5884 tablet_service.cc:1514] Processing DeleteTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:04 UTC) from {username='slave'} at 127.0.0.1:51536
I20260808 08:52:04.291576 6091 tablet_service.cc:1514] Processing DeleteTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:04 UTC) from {username='slave'} at 127.0.0.1:50900
I20260808 08:52:04.292387 5680 tablet_service.cc:1514] Processing DeleteTablet for tablet 32d5a765b2334a56a08c0ebe07b22091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:04 UTC) from {username='slave'} at 127.0.0.1:56200
I20260808 08:52:04.292989 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 5577
I20260808 08:52:04.296602 6286 tablet_replica.cc:330] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: stopping tablet replica
I20260808 08:52:04.297173 6286 raft_consensus.cc:2229] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:04.297806 6286 raft_consensus.cc:2258] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:04.299783 6286 ts_tablet_manager.cc:1905] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:04.306074 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.294134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56212 (local address 127.8.149.65:44989)
0808 08:52:04.294318 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.294324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.298465 (+ 4141us) server_negotiation.cc:407] Connection header received
0808 08:52:04.298714 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.298718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.298796 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.298868 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:04.299524 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.300482 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.302250 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.302829 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.302927 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.304388 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:04.304399 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:04.304417 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:04.305179 (+ 762us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:04.305237 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:04.305264 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:04.305355 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.305590 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.305690 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:52:04.306748 6282 tablet_replica.cc:330] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: stopping tablet replica
I20260808 08:52:04.307021 5772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:04.307209 6282 raft_consensus.cc:2229] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:04.307821 6282 raft_consensus.cc:2258] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:04.309773 6282 ts_tablet_manager.cc:1905] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:04.314972 6282 ts_tablet_manager.cc:1918] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:04.315147 6282 log.cc:1196] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/32d5a765b2334a56a08c0ebe07b22091
I20260808 08:52:04.315454 6281 tablet_replica.cc:330] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: stopping tablet replica
I20260808 08:52:04.315622 6282 ts_tablet_manager.cc:1939] T 32d5a765b2334a56a08c0ebe07b22091 P 731a645527464f7ba6e4d38e4cd3c2ce: Deleting consensus metadata
I20260808 08:52:04.315828 6281 raft_consensus.cc:2229] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:04.316340 6281 raft_consensus.cc:2258] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:04.317348 5449 catalog_manager.cc:4841] TS 731a645527464f7ba6e4d38e4cd3c2ce (127.8.149.67:38853): tablet 32d5a765b2334a56a08c0ebe07b22091 (table test-table [id=41625b31d20f481fa239c352efc86ea1]) successfully deleted
I20260808 08:52:04.318356 6281 ts_tablet_manager.cc:1905] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:04.325454 6281 ts_tablet_manager.cc:1918] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:04.325627 6281 log.cc:1196] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/32d5a765b2334a56a08c0ebe07b22091
I20260808 08:52:04.326150 6281 ts_tablet_manager.cc:1939] T 32d5a765b2334a56a08c0ebe07b22091 P 88adc0ae59614c1f8b02624fd30a5cb4: Deleting consensus metadata
I20260808 08:52:04.327646 5450 catalog_manager.cc:4841] TS 88adc0ae59614c1f8b02624fd30a5cb4 (127.8.149.66:41889): tablet 32d5a765b2334a56a08c0ebe07b22091 (table test-table [id=41625b31d20f481fa239c352efc86ea1]) successfully deleted
I20260808 08:52:04.406328 6286 ts_tablet_manager.cc:1918] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:04.406651 6286 log.cc:1196] T 32d5a765b2334a56a08c0ebe07b22091 P 09f2e67b53c246168bfd9ec880b040e9: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/32d5a765b2334a56a08c0ebe07b22091
I20260808 08:52:04.406984 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 5577
I20260808 08:52:04.430984 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 5789
W20260808 08:52:04.430909 5452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.149.65:44989 (error 108)
I20260808 08:52:04.432713 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.432311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56228)
0808 08:52:04.432473 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.432581 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:52:04.432920 5452 catalog_manager.cc:4584] TS 09f2e67b53c246168bfd9ec880b040e9 (127.8.149.65:44989): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 32d5a765b2334a56a08c0ebe07b22091: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
I20260808 08:52:04.437811 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.431855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51540 (local address 127.8.149.66:41889)
0808 08:52:04.432048 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.432054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.432072 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:52:04.432295 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.432299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.432388 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.432490 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:04.432909 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.433676 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.434973 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.435342 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.435436 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.436598 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:04.436606 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:04.436618 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:04.437166 (+ 548us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:04.437209 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:04.437227 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:04.437310 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.437501 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.437587 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:52:04.438513 5986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:04.486354 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.485915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56234)
0808 08:52:04.486108 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.486199 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 08:52:04.487438 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.487052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56250)
0808 08:52:04.487210 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.487280 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 08:52:04.526301 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 5789
I20260808 08:52:04.547966 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.547505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56266)
0808 08:52:04.547705 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.547795 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 08:52:04.549070 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.548699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56268)
0808 08:52:04.548836 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.548947 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:52:04.558868 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 5998
I20260808 08:52:04.566650 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.559652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50912 (local address 127.8.149.67:38853)
0808 08:52:04.559812 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:04.559817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:04.559834 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:52:04.560064 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:04.560067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:04.560228 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:04.560310 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:04.560787 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.561610 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.563578 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:04.563934 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:04.564026 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:04.565247 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:04.565256 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:04.565270 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:04.565822 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:04.565869 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:04.565893 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:04.565982 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:04.566219 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 08:52:04.566308 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:52:04.567252 6201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:04.629874 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.629439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56280)
0808 08:52:04.629644 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.629730 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:52:04.630889 6226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:04.630498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44989 (local address 127.0.0.1:56286)
0808 08:52:04.630709 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:04.630777 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 08:52:04.653822 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 5998
I20260808 08:52:04.678490 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 5428
I20260808 08:52:04.679525 5535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:04.786600 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 5428
2026-08-08T08:52:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2776 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:04 dist-test-slave-7vjv krb5kdc[6299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:04 dist-test-slave-7vjv krb5kdc[6299](info): set up 2 sockets
Aug 08 08:52:04 dist-test-slave-7vjv krb5kdc[6299](info): commencing operation
krb5kdc: starting...
W20260808 08:52:06.065441 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:06 dist-test-slave-7vjv krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:06.333401 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:32961
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:32961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:06.673630 6327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:06.673911 6327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:06.674000 6327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:06.681005 6327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:06.681092 6327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:06.681156 6327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:06.681211 6327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:06.681270 6327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:06.690335 6327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:32961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:32961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:06.691531 6327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:06.692829 6327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:06.704798 6342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:06.704840 6338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:06.704813 6337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:06.706424 6327 server_base.cc:1034] running on GCE node
I20260808 08:52:06.707180 6327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:06.708609 6327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:06.709852 6327 hybrid_clock.cc:648] HybridClock initialized: now 1786179126709808 us; error 46 us; skew 500 ppm
I20260808 08:52:06.710251 6327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:06 dist-test-slave-7vjv krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:06.717747 6327 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:06.719185 6327 webserver.cc:460] Webserver started at http://127.8.149.126:35259/ using document root <none> and password file <none>
I20260808 08:52:06.719888 6327 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:06.720041 6327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:06.720444 6327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:06.723253 6327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "329dd180cf464ea7a3fa4412054672dc"
format_stamp: "Formatted at 2026-08-08 08:52:06 on dist-test-slave-7vjv"
server_key: "3f7a36bc40e8ac4fa7c36e6ad74cd539"
server_key_iv: "ad5968742f2b3fd67abce117da5ee78b"
server_key_version: "encryptionkey@0"
I20260808 08:52:06.724035 6327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "329dd180cf464ea7a3fa4412054672dc"
format_stamp: "Formatted at 2026-08-08 08:52:06 on dist-test-slave-7vjv"
server_key: "3f7a36bc40e8ac4fa7c36e6ad74cd539"
server_key_iv: "ad5968742f2b3fd67abce117da5ee78b"
server_key_version: "encryptionkey@0"
I20260808 08:52:06.729164 6327 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:52:06.732450 6354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:06.733800 6327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:52:06.734067 6327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "329dd180cf464ea7a3fa4412054672dc"
format_stamp: "Formatted at 2026-08-08 08:52:06 on dist-test-slave-7vjv"
server_key: "3f7a36bc40e8ac4fa7c36e6ad74cd539"
server_key_iv: "ad5968742f2b3fd67abce117da5ee78b"
server_key_version: "encryptionkey@0"
I20260808 08:52:06.734299 6327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:06.757242 6327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:06.761790 6327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:06.762156 6327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:06.783193 6327 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:32961
I20260808 08:52:06.783212 6441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:32961 every 8 connection(s)
I20260808 08:52:06.784794 6327 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:06.788570 6443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:06.790678 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 6327
I20260808 08:52:06.790886 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:06.791483 8789 external_mini_cluster.cc:1428] Setting key 15501c966ac286658de94440fd66ff13
I20260808 08:52:06.801085 6443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: Bootstrap starting.
I20260808 08:52:06.804778 6443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:06.806108 6443 log.cc:824] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:52:06 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:06.809178 6443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: No bootstrap required, opened a new log
I20260808 08:52:06.815908 6448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:06.793547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53758 (local address 127.8.149.126:32961)
0808 08:52:06.794456 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:06.794468 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:06.794515 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:52:06.796382 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:06.796404 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:06.796753 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:06.797101 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:06.798864 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:06.800337 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:06.802284 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:06.803017 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:06.803168 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:06.808532 (+ 5364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:06.808541 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:06.808554 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:06.808593 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:06.811826 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:06.812631 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:06.812637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:06.812646 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:06.812802 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:06.813222 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:06.813236 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:06.813238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:06.813750 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:06.814115 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:06.814557 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 08:52:06.814961 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":387,"threads_started":1}
I20260808 08:52:06.817081 6443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } }
I20260808 08:52:06.817533 6443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:06.817644 6443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329dd180cf464ea7a3fa4412054672dc, State: Initialized, Role: FOLLOWER
I20260808 08:52:06.818275 6443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } }
I20260808 08:52:06.818550 6443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:06.818715 6443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:06.818920 6443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:06.821062 6443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } }
I20260808 08:52:06.821516 6443 leader_election.cc:302] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 329dd180cf464ea7a3fa4412054672dc; no voters:
I20260808 08:52:06.822108 6443 leader_election.cc:288] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:06.822248 6451 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:06.822997 6451 raft_consensus.cc:686] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [term 1 LEADER]: Becoming Leader. State: Replica: 329dd180cf464ea7a3fa4412054672dc, State: Running, Role: LEADER
I20260808 08:52:06.823580 6451 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } }
I20260808 08:52:06.824352 6443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:06.826731 6452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "329dd180cf464ea7a3fa4412054672dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } } }
I20260808 08:52:06.827135 6462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329dd180cf464ea7a3fa4412054672dc. Latest consensus state: current_term: 1 leader_uuid: "329dd180cf464ea7a3fa4412054672dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329dd180cf464ea7a3fa4412054672dc" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 32961 } } }
I20260808 08:52:06.827636 6462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:06.827637 6452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:06.836133 6472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:06.841114 6472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:06.849756 6472 catalog_manager.cc:1347] Generated new cluster ID: 52e4dbac4aa94e54a01573eb864f1a4c
I20260808 08:52:06.849854 6472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:06.867715 6472 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:06.869454 6472 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:06.877454 6472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: Generated new TSK 0
I20260808 08:52:06.878314 6472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:52:06.954890 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:07.283515 6489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:07.283744 6489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:07.283830 6489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:07.290386 6489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:07.290477 6489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:07.290573 6489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:52:07.299180 6489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:07.300468 6489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:07.301671 6489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:07.314556 6496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:07.314651 6501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:07.314597 6497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:07.315943 6489 server_base.cc:1034] running on GCE node
I20260808 08:52:07.316565 6489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:07.317504 6489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:07.318718 6489 hybrid_clock.cc:648] HybridClock initialized: now 1786179127318666 us; error 42 us; skew 500 ppm
I20260808 08:52:07.319003 6489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:07 dist-test-slave-7vjv krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179127, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:07.322170 6489 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:52:07.323504 6489 webserver.cc:460] Webserver started at http://127.8.149.65:45935/ using document root <none> and password file <none>
I20260808 08:52:07.324229 6489 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:07.324366 6489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:07.324693 6489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:07.327520 6489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "d46b2018c47d4481b5e66fcb23665cf0"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "2e06ba7dc16cc1c90ef5839c645946a5"
server_key_iv: "a5a267585b6d9c514478f91c7361f71c"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.328330 6489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "d46b2018c47d4481b5e66fcb23665cf0"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "2e06ba7dc16cc1c90ef5839c645946a5"
server_key_iv: "a5a267585b6d9c514478f91c7361f71c"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.333314 6489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:52:07.336858 6512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.338241 6489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:52:07.338413 6489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "d46b2018c47d4481b5e66fcb23665cf0"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "2e06ba7dc16cc1c90ef5839c645946a5"
server_key_iv: "a5a267585b6d9c514478f91c7361f71c"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.338603 6489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:07.355870 6489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:07.359961 6489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:07.360281 6489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:07.361159 6489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:07.362370 6489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:07.362473 6489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.362612 6489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:07.362685 6489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.395612 6489 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:44527
I20260808 08:52:07.395654 6686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:44527 every 8 connection(s)
I20260808 08:52:07.396855 6489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:52:07.400817 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 6489
I20260808 08:52:07.401015 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:52:07.401551 8789 external_mini_cluster.cc:1428] Setting key 042c9057eb46ebe324dfa9b64e736c8f
Aug 08 08:52:07 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179127, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:07.418448 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:07.399236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:44113 (local address 127.8.149.126:32961)
0808 08:52:07.399668 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:07.399674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:07.400758 (+ 1084us) server_negotiation.cc:407] Connection header received
0808 08:52:07.402939 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:07.402942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:07.403003 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:07.403086 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:07.405023 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.405788 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.408173 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.408538 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.408644 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:07.412853 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:07.412858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:07.412862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:07.412899 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:07.415540 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:07.416264 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:07.416268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:07.416270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:07.416383 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:07.416820 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:07.416825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:07.416827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:07.417074 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:07.417227 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:07.417878 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 08:52:07.418098 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":208,"threads_started":1}
I20260808 08:52:07.419342 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:07.399806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:32961 (local address 127.8.149.65:44113)
0808 08:52:07.400572 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:07.400638 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:07.402637 (+ 1999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:07.403346 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:07.403352 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:07.404044 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:07.404850 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:07.404877 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.405961 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.405970 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:07.407978 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:07.407994 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.408766 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.408774 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:07.409079 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:07.409889 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:07.409927 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:07.412632 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:07.415681 (+ 3049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:07.415689 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:07.415702 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:07.416137 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:07.416499 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:07.416516 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:07.416519 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:07.416703 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:07.417203 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:07.417210 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:07.417525 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 08:52:07.417767 (+ 242us) client_negotiation.cc:240] Negotiation successful
0808 08:52:07.418237 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":290,"threads_started":1}
I20260808 08:52:07.420959 6688 heartbeater.cc:347] Connected to a master server at 127.8.149.126:32961
I20260808 08:52:07.421250 6688 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:07.421933 6688 heartbeater.cc:511] Master 127.8.149.126:32961 requested a full tablet report, sending...
I20260808 08:52:07.424183 6383 ts_manager.cc:194] Registered new tserver with Master: d46b2018c47d4481b5e66fcb23665cf0 (127.8.149.65:44527)
I20260808 08:52:07.426352 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:44113
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:52:07.471483 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:07.806511 6700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:07.806742 6700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:07.806828 6700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:07.814404 6700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:07.814515 6700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:07.814631 6700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:07.824482 6700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:07.825748 6700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:07.827008 6700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:07.840744 6711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:07.840790 6708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:07.840930 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:07.841745 6700 server_base.cc:1034] running on GCE node
I20260808 08:52:07.842327 6700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:07.843331 6700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:07.844573 6700 hybrid_clock.cc:648] HybridClock initialized: now 1786179127844527 us; error 53 us; skew 500 ppm
I20260808 08:52:07.844990 6700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:07 dist-test-slave-7vjv krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179127, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:07.848573 6700 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:52:07.850071 6700 webserver.cc:460] Webserver started at http://127.8.149.66:35883/ using document root <none> and password file <none>
I20260808 08:52:07.850749 6700 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:07.850910 6700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:07.851264 6700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:07.854159 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "e6aa877615fa486ab531e9c1c30837f1"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "df38b2a8bf11bbc451342be332be9f1e"
server_key_iv: "a5ea00f0c6c8a59da41739ad2af2bf13"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.854936 6700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "e6aa877615fa486ab531e9c1c30837f1"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "df38b2a8bf11bbc451342be332be9f1e"
server_key_iv: "a5ea00f0c6c8a59da41739ad2af2bf13"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.859963 6700 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:52:07.863145 6724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.864569 6700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:07.864755 6700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "e6aa877615fa486ab531e9c1c30837f1"
format_stamp: "Formatted at 2026-08-08 08:52:07 on dist-test-slave-7vjv"
server_key: "df38b2a8bf11bbc451342be332be9f1e"
server_key_iv: "a5ea00f0c6c8a59da41739ad2af2bf13"
server_key_version: "encryptionkey@0"
I20260808 08:52:07.864985 6700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:07.887832 6700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:07.892184 6700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:07.892479 6700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:07.893421 6700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:07.894675 6700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:07.894786 6700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.894949 6700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:07.895035 6700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:07.928144 6700 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:39533
I20260808 08:52:07.928229 6911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:39533 every 8 connection(s)
I20260808 08:52:07.929345 6700 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:07.938102 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 6700
I20260808 08:52:07.938289 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:07.938719 8789 external_mini_cluster.cc:1428] Setting key f5129882953b91ee7b1e01c91894b534
Aug 08 08:52:07 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179127, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:07.949330 6915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:07.931744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:58547 (local address 127.8.149.126:32961)
0808 08:52:07.932208 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:07.932212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:07.933081 (+ 869us) server_negotiation.cc:407] Connection header received
0808 08:52:07.934750 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:07.934756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:07.934845 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:07.934962 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:07.936435 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.937148 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.938895 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.939523 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.939674 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:07.943511 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:07.943516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:07.943520 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:07.943551 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:07.946183 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:07.946981 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:07.946993 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:07.946996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:07.947123 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:07.947575 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:07.947579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:07.947581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:07.947821 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:07.947983 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:07.948716 (+ 733us) server_negotiation.cc:299] Negotiation successful
0808 08:52:07.948957 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":247,"threads_started":1}
I20260808 08:52:07.950142 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:07.932204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:32961 (local address 127.8.149.66:58547)
0808 08:52:07.932914 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:07.932954 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:07.934494 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:07.935183 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:07.935190 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:07.935667 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:07.936256 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:07.936275 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.937315 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.937320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:07.938717 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:07.938733 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:07.939756 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:07.939763 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:07.940004 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:07.940756 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:07.940777 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:07.943286 (+ 2509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:07.946340 (+ 3054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:07.946348 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:07.946370 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:07.946809 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:07.947239 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:07.947244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:07.947248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:07.947443 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:07.947963 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:07.947970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:07.948352 (+ 382us) client_negotiation.cc:769] Sending connection context
0808 08:52:07.948609 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 08:52:07.949081 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":263,"threads_started":1}
I20260808 08:52:07.951494 6912 heartbeater.cc:347] Connected to a master server at 127.8.149.126:32961
I20260808 08:52:07.951795 6912 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:07.952571 6912 heartbeater.cc:511] Master 127.8.149.126:32961 requested a full tablet report, sending...
I20260808 08:52:07.953939 6383 ts_manager.cc:194] Registered new tserver with Master: e6aa877615fa486ab531e9c1c30837f1 (127.8.149.66:39533)
I20260808 08:52:07.954720 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:58547
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:52:08.003970 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:08.336251 6921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:08.336661 6921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:08.336825 6921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:08.345623 6921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:08.345736 6921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:08.345927 6921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:08.355082 6921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:32961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:08.356395 6921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:08.357613 6921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:08.371059 6929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:08.371095 6930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:08.371316 6934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:08.372226 6921 server_base.cc:1034] running on GCE node
I20260808 08:52:08.372798 6921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:08.373744 6921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:08.374948 6921 hybrid_clock.cc:648] HybridClock initialized: now 1786179128374881 us; error 57 us; skew 500 ppm
I20260808 08:52:08.375263 6921 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:08 dist-test-slave-7vjv krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179128, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:08.378381 6921 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:52:08.379756 6921 webserver.cc:460] Webserver started at http://127.8.149.67:45697/ using document root <none> and password file <none>
I20260808 08:52:08.380455 6921 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:08.380592 6921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:08.380909 6921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:08.383603 6921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "c8ef5fb15db24fb8b2513f859f2aed23"
format_stamp: "Formatted at 2026-08-08 08:52:08 on dist-test-slave-7vjv"
server_key: "76e233e32067e681d4a69a271e6d3495"
server_key_iv: "e5950bcb7cbf588f415d48c8b3ce99c6"
server_key_version: "encryptionkey@0"
I20260808 08:52:08.384467 6921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "c8ef5fb15db24fb8b2513f859f2aed23"
format_stamp: "Formatted at 2026-08-08 08:52:08 on dist-test-slave-7vjv"
server_key: "76e233e32067e681d4a69a271e6d3495"
server_key_iv: "e5950bcb7cbf588f415d48c8b3ce99c6"
server_key_version: "encryptionkey@0"
I20260808 08:52:08.389371 6921 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 08:52:08.392668 6942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:08.393853 6921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:52:08.394026 6921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "c8ef5fb15db24fb8b2513f859f2aed23"
format_stamp: "Formatted at 2026-08-08 08:52:08 on dist-test-slave-7vjv"
server_key: "76e233e32067e681d4a69a271e6d3495"
server_key_iv: "e5950bcb7cbf588f415d48c8b3ce99c6"
server_key_version: "encryptionkey@0"
I20260808 08:52:08.394219 6921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:08.411981 6921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:08.416002 6921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:08.416301 6921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:08.417199 6921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:08.418431 6921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:08.418504 6921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:08.418678 6921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:08.418730 6921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:08.429483 6688 heartbeater.cc:503] Master 127.8.149.126:32961 was elected leader, sending a full tablet report...
I20260808 08:52:08.452728 6921 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44493
I20260808 08:52:08.452759 7134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44493 every 8 connection(s)
I20260808 08:52:08.453895 6921 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:08.460019 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 6921
I20260808 08:52:08.460242 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:08.460719 8789 external_mini_cluster.cc:1428] Setting key 5cc819c90a4dccabfe8cb00d34471ebf
Aug 08 08:52:08 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179128, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:08.473621 7137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.456451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:50479 (local address 127.8.149.126:32961)
0808 08:52:08.456939 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.456946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.458002 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 08:52:08.459740 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.459749 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.459867 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.460009 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:08.461545 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.462693 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.464599 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.465042 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.465149 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.468362 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:08.468367 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:08.468370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:08.468404 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:08.471015 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:08.471626 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:08.471630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:08.471632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:08.471741 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:08.472178 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:08.472183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:08.472186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:08.472444 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:08.472563 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.473162 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.473343 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":207,"threads_started":1}
I20260808 08:52:08.474659 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.457075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:32961 (local address 127.8.149.67:50479)
0808 08:52:08.457853 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.457891 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.459437 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.460263 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.460271 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.460883 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:08.461395 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.461412 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.462871 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.462877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.464449 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.464461 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.465235 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.465240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.465423 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.466064 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:08.466090 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:08.468177 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:08.471133 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:08.471139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:08.471149 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:08.471518 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:08.471846 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:08.471850 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:08.471852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:08.472026 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:08.472565 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:08.472570 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:08.472827 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.473048 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.473398 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":299,"threads_started":1}
I20260808 08:52:08.476125 7135 heartbeater.cc:347] Connected to a master server at 127.8.149.126:32961
I20260808 08:52:08.476426 7135 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:08.477089 7135 heartbeater.cc:511] Master 127.8.149.126:32961 requested a full tablet report, sending...
I20260808 08:52:08.478345 6383 ts_manager.cc:194] Registered new tserver with Master: c8ef5fb15db24fb8b2513f859f2aed23 (127.8.149.67:44493)
I20260808 08:52:08.479097 6383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:50479
I20260808 08:52:08.487782 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:08.503880 7137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.491963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.8.149.126:32961)
0808 08:52:08.492162 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.492169 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.492564 (+ 395us) server_negotiation.cc:407] Connection header received
0808 08:52:08.492720 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.492723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.492776 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.492853 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:08.494182 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.494843 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.496081 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.496505 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.496610 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.499047 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:08.499051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:08.499054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:08.499080 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:08.501526 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:08.502274 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:08.502281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:08.502287 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:08.502422 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:08.502776 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:08.502779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:08.502781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:08.503082 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:08.503292 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.503563 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.503679 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:52:08.507382 6383 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:08.514124 6383 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:08.556578 7175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.529866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.8.149.66:39533)
0808 08:52:08.547881 (+ 18015us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.547905 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.549203 (+ 1298us) server_negotiation.cc:407] Connection header received
0808 08:52:08.549306 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.549311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.549546 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.549745 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:08.550651 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.552294 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.554608 (+ 2314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.555439 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.555584 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.555823 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.556116 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.556289 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17838,"thread_start_us":17737,"threads_started":1}
I20260808 08:52:08.556943 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.526303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:44493 (local address 127.0.0.1:49750)
0808 08:52:08.546779 (+ 20476us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.546837 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.547039 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.549911 (+ 2872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.549916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.549940 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:08.550468 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.550481 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.552607 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.552611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.554059 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.554070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.555800 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.555809 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.555970 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.556000 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.556070 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.556285 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20173,"mutex_wait_us":40,"spinlock_wait_cycles":1408,"thread_start_us":22217,"threads_started":1}
I20260808 08:52:08.557106 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.526549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49750 (local address 127.8.149.67:44493)
0808 08:52:08.549285 (+ 22736us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.549292 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.549324 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:52:08.549441 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.549447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.549651 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.550648 (+ 997us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:08.550907 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.552470 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.554213 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.555523 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.556220 (+ 697us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.556446 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.556512 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.556673 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22569,"thread_start_us":22403,"threads_started":1}
I20260808 08:52:08.557147 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.527387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41138 (local address 127.8.149.65:44527)
0808 08:52:08.547708 (+ 20321us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.547722 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.548563 (+ 841us) server_negotiation.cc:407] Connection header received
0808 08:52:08.549056 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.549065 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.549315 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.549486 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:08.550579 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.551797 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.554415 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.555738 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.555865 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.556142 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.556656 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.556818 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20083,"thread_start_us":19848,"threads_started":1}
I20260808 08:52:08.557821 7166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.529654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:39533 (local address 127.0.0.1:58296)
0808 08:52:08.548988 (+ 19334us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.549012 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.549137 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.549794 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.549799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.549826 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:08.550426 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.550442 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.552437 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.552443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.554481 (+ 2038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.554490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.555672 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.555679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.555874 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.555919 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.556042 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.557435 (+ 1393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19059,"mutex_wait_us":4,"thread_start_us":16670,"threads_started":1}
I20260808 08:52:08.557885 7169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.526612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44527 (local address 127.0.0.1:41138)
0808 08:52:08.548419 (+ 21807us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.548440 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.548720 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.549538 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.549544 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.549584 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:08.550348 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.550373 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.551932 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.551940 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.554266 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.554280 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.556280 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.556286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.556449 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.556482 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.557361 (+ 879us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.557486 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21623,"mutex_wait_us":84,"thread_start_us":21456,"threads_started":1}
I20260808 08:52:08.560998 6590 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e (DEFAULT_TABLE table=test-table [id=f15aa354f5254c29ada7af9616f7551d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:08.561174 7024 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e (DEFAULT_TABLE table=test-table [id=f15aa354f5254c29ada7af9616f7551d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:08.561174 6810 tablet_service.cc:1467] Processing CreateTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e (DEFAULT_TABLE table=test-table [id=f15aa354f5254c29ada7af9616f7551d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:08.562222 6590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbbfae058ff46febcfb5562fbf9dc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:08.562441 7024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbbfae058ff46febcfb5562fbf9dc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:08.562433 6810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bbbfae058ff46febcfb5562fbf9dc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:08.574613 7176 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Bootstrap starting.
I20260808 08:52:08.578156 7176 tablet_bootstrap.cc:654] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:08.579195 7176 log.cc:824] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:08.581197 7177 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Bootstrap starting.
I20260808 08:52:08.582803 7178 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Bootstrap starting.
I20260808 08:52:08.583215 7176 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: No bootstrap required, opened a new log
I20260808 08:52:08.583544 7176 ts_tablet_manager.cc:1397] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:52:08.584952 7177 tablet_bootstrap.cc:654] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:08.585711 7178 tablet_bootstrap.cc:654] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:08.586138 7177 log.cc:824] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:08.586606 7178 log.cc:824] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:08.589046 7177 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: No bootstrap required, opened a new log
I20260808 08:52:08.589318 7177 ts_tablet_manager.cc:1397] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260808 08:52:08.589707 7178 tablet_bootstrap.cc:492] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: No bootstrap required, opened a new log
I20260808 08:52:08.590023 7178 ts_tablet_manager.cc:1397] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260808 08:52:08.592777 7176 raft_consensus.cc:348] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.593179 7176 raft_consensus.cc:374] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:08.593312 7176 raft_consensus.cc:729] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46b2018c47d4481b5e66fcb23665cf0, State: Initialized, Role: FOLLOWER
I20260808 08:52:08.593948 7176 consensus_queue.cc:260] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.595662 7176 ts_tablet_manager.cc:1428] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260808 08:52:08.599327 7177 raft_consensus.cc:348] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.599747 7177 raft_consensus.cc:374] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:08.599872 7177 raft_consensus.cc:729] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ef5fb15db24fb8b2513f859f2aed23, State: Initialized, Role: FOLLOWER
I20260808 08:52:08.599956 7178 raft_consensus.cc:348] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.600370 7178 raft_consensus.cc:374] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:08.600476 7178 raft_consensus.cc:729] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6aa877615fa486ab531e9c1c30837f1, State: Initialized, Role: FOLLOWER
I20260808 08:52:08.600584 7177 consensus_queue.cc:260] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.601061 7178 consensus_queue.cc:260] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.601626 7135 heartbeater.cc:503] Master 127.8.149.126:32961 was elected leader, sending a full tablet report...
I20260808 08:52:08.602092 6912 heartbeater.cc:503] Master 127.8.149.126:32961 was elected leader, sending a full tablet report...
I20260808 08:52:08.602209 7177 ts_tablet_manager.cc:1428] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260808 08:52:08.602633 7178 ts_tablet_manager.cc:1428] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Time spent starting tablet: real 0.012s user 0.010s sys 0.002s
W20260808 08:52:08.649065 6690 tablet.cc:2369] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:08.681278 6914 tablet.cc:2369] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:08.705579 7136 tablet.cc:2369] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:52:08.872442 7185 raft_consensus.cc:482] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:08.872888 7185 raft_consensus.cc:504] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.874848 7185 leader_election.cc:288] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d46b2018c47d4481b5e66fcb23665cf0 (127.8.149.65:44527), e6aa877615fa486ab531e9c1c30837f1 (127.8.149.66:39533)
I20260808 08:52:08.880563 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.875286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:33307 (local address 127.8.149.65:44527)
0808 08:52:08.875516 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.875524 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.875840 (+ 316us) server_negotiation.cc:407] Connection header received
0808 08:52:08.876150 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.876156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.876226 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.876334 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:08.876713 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.877418 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.878962 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.879688 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.879862 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.879941 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.880208 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.880319 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:52:08.880596 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.875262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:44527 (local address 127.8.149.67:33307)
0808 08:52:08.875718 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.875744 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.875947 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.876359 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.876363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.876405 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:08.876575 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.876584 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.877548 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.877554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.878806 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.878816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.879844 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.879854 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.880040 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.880063 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.880184 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.880310 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":1}
I20260808 08:52:08.881625 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.875307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:39533 (local address 127.8.149.67:40469)
0808 08:52:08.876157 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:08.876172 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:08.876315 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:08.876676 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:08.876681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:08.876705 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:08.877071 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.877094 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.878075 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.878081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.879482 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:08.879493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.880852 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.880861 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:08.881074 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.881118 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:52:08.881239 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:52:08.881385 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":417,"threads_started":1}
I20260808 08:52:08.881657 7175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.875506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:40469 (local address 127.8.149.66:39533)
0808 08:52:08.875739 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.875748 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.876264 (+ 516us) server_negotiation.cc:407] Connection header received
0808 08:52:08.876484 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.876488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.876554 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.876661 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:08.877262 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.877924 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.879657 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.880491 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.880689 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.880791 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.881270 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.881419 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:52:08.881842 6619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbbfae058ff46febcfb5562fbf9dc9e" candidate_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46b2018c47d4481b5e66fcb23665cf0" is_pre_election: true
I20260808 08:52:08.882421 6619 raft_consensus.cc:2454] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ef5fb15db24fb8b2513f859f2aed23 in term 0.
I20260808 08:52:08.882776 6841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbbfae058ff46febcfb5562fbf9dc9e" candidate_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6aa877615fa486ab531e9c1c30837f1" is_pre_election: true
I20260808 08:52:08.883152 6945 leader_election.cc:302] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ef5fb15db24fb8b2513f859f2aed23, d46b2018c47d4481b5e66fcb23665cf0; no voters:
I20260808 08:52:08.883332 6841 raft_consensus.cc:2454] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8ef5fb15db24fb8b2513f859f2aed23 in term 0.
I20260808 08:52:08.883493 7185 raft_consensus.cc:2781] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:08.883625 7185 raft_consensus.cc:482] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:08.883730 7185 raft_consensus.cc:3037] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:08.885846 7185 raft_consensus.cc:504] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.886449 7185 leader_election.cc:288] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [CANDIDATE]: Term 1 election: Requested vote from peers d46b2018c47d4481b5e66fcb23665cf0 (127.8.149.65:44527), e6aa877615fa486ab531e9c1c30837f1 (127.8.149.66:39533)
I20260808 08:52:08.886823 6619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbbfae058ff46febcfb5562fbf9dc9e" candidate_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46b2018c47d4481b5e66fcb23665cf0"
I20260808 08:52:08.886965 6841 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bbbfae058ff46febcfb5562fbf9dc9e" candidate_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6aa877615fa486ab531e9c1c30837f1"
I20260808 08:52:08.887032 6619 raft_consensus.cc:3037] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:08.887156 6841 raft_consensus.cc:3037] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:08.890139 6619 raft_consensus.cc:2454] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ef5fb15db24fb8b2513f859f2aed23 in term 1.
I20260808 08:52:08.890139 6841 raft_consensus.cc:2454] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8ef5fb15db24fb8b2513f859f2aed23 in term 1.
I20260808 08:52:08.890501 6943 leader_election.cc:302] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8ef5fb15db24fb8b2513f859f2aed23, e6aa877615fa486ab531e9c1c30837f1; no voters:
I20260808 08:52:08.890849 7185 raft_consensus.cc:2781] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:08.891296 7185 raft_consensus.cc:686] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 1 LEADER]: Becoming Leader. State: Replica: c8ef5fb15db24fb8b2513f859f2aed23, State: Running, Role: LEADER
I20260808 08:52:08.891784 7185 consensus_queue.cc:237] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } }
I20260808 08:52:08.895988 6383 catalog_manager.cc:5495] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8ef5fb15db24fb8b2513f859f2aed23 (127.8.149.67). New cstate: current_term: 1 leader_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8ef5fb15db24fb8b2513f859f2aed23" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:08.990423 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:08.985210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49752 (local address 127.8.149.67:44493)
0808 08:52:08.985424 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:08.985429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:08.985447 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:52:08.985601 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:08.985612 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:08.985697 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:08.985846 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:08.986241 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.986970 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.988349 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:08.988716 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:08.988843 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:08.989419 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:08.989895 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:08.990062 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:08.990176 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 08:52:08.990216 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:52:08.998093 6619 raft_consensus.cc:1261] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 1 FOLLOWER]: Refusing update from remote peer c8ef5fb15db24fb8b2513f859f2aed23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:08.998099 6841 raft_consensus.cc:1261] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 1 FOLLOWER]: Refusing update from remote peer c8ef5fb15db24fb8b2513f859f2aed23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:08.999128 7185 consensus_queue.cc:1035] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d46b2018c47d4481b5e66fcb23665cf0" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 44527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:08.999398 7190 consensus_queue.cc:1035] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa877615fa486ab531e9c1c30837f1" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 39533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:09.009542 7195 mvcc.cc:205] Tried to move back new op lower bound from 7316189712366407680 to 7316189711944572928. Current Snapshot: MvccSnapshot[applied={T|T < 7316189712366407680}]
I20260808 08:52:09.011636 7196 mvcc.cc:205] Tried to move back new op lower bound from 7316189712366407680 to 7316189711944572928. Current Snapshot: MvccSnapshot[applied={T|T < 7316189712366407680}]
I20260808 08:52:09.026113 6383 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:09.026337 6383 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:09.029548 6383 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 329dd180cf464ea7a3fa4412054672dc: Sending DeleteTablet for 3 replicas of tablet 9bbbfae058ff46febcfb5562fbf9dc9e
I20260808 08:52:09.030607 7024 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:09 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:49750
I20260808 08:52:09.030759 6590 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:09 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:41138
I20260808 08:52:09.031224 6810 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bbbfae058ff46febcfb5562fbf9dc9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:09 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:58296
I20260808 08:52:09.033289 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 6489
I20260808 08:52:09.043278 7215 tablet_replica.cc:330] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: stopping tablet replica
I20260808 08:52:09.043406 7216 tablet_replica.cc:330] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: stopping tablet replica
I20260808 08:52:09.043879 7215 raft_consensus.cc:2229] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:09.043885 7216 raft_consensus.cc:2229] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:09.044484 7216 raft_consensus.cc:2258] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:09.044488 7215 raft_consensus.cc:2258] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:09.046911 7216 ts_tablet_manager.cc:1905] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:09.047043 7215 ts_tablet_manager.cc:1905] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:09.053954 7216 ts_tablet_manager.cc:1918] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:09.054176 7216 log.cc:1196] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/9bbbfae058ff46febcfb5562fbf9dc9e
I20260808 08:52:09.054829 7216 ts_tablet_manager.cc:1939] T 9bbbfae058ff46febcfb5562fbf9dc9e P e6aa877615fa486ab531e9c1c30837f1: Deleting consensus metadata
I20260808 08:52:09.055418 7215 ts_tablet_manager.cc:1918] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:09.055609 7215 log.cc:1196] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/9bbbfae058ff46febcfb5562fbf9dc9e
I20260808 08:52:09.056485 7211 tablet_replica.cc:330] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: stopping tablet replica
I20260808 08:52:09.056921 7211 raft_consensus.cc:2229] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:09.056998 6356 catalog_manager.cc:4841] TS e6aa877615fa486ab531e9c1c30837f1 (127.8.149.66:39533): tablet 9bbbfae058ff46febcfb5562fbf9dc9e (table test-table [id=f15aa354f5254c29ada7af9616f7551d]) successfully deleted
I20260808 08:52:09.057600 7211 raft_consensus.cc:2258] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:09.059788 7211 ts_tablet_manager.cc:1905] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:09.061522 7215 ts_tablet_manager.cc:1939] T 9bbbfae058ff46febcfb5562fbf9dc9e P d46b2018c47d4481b5e66fcb23665cf0: Deleting consensus metadata
I20260808 08:52:09.063212 6357 catalog_manager.cc:4841] TS d46b2018c47d4481b5e66fcb23665cf0 (127.8.149.65:44527): tablet 9bbbfae058ff46febcfb5562fbf9dc9e (table test-table [id=f15aa354f5254c29ada7af9616f7551d]) successfully deleted
I20260808 08:52:09.067749 7211 ts_tablet_manager.cc:1918] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:09.067956 7211 log.cc:1196] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/9bbbfae058ff46febcfb5562fbf9dc9e
Aug 08 08:52:09 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:52:09.068533 7211 ts_tablet_manager.cc:1939] T 9bbbfae058ff46febcfb5562fbf9dc9e P c8ef5fb15db24fb8b2513f859f2aed23: Deleting consensus metadata
I20260808 08:52:09.070670 6359 catalog_manager.cc:4841] TS c8ef5fb15db24fb8b2513f859f2aed23 (127.8.149.67:44493): tablet 9bbbfae058ff46febcfb5562fbf9dc9e (table test-table [id=f15aa354f5254c29ada7af9616f7551d]) successfully deleted
I20260808 08:52:09.075927 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:09.034964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41144 (local address 127.8.149.65:44527)
0808 08:52:09.035173 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:09.035182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:09.056717 (+ 21535us) server_negotiation.cc:407] Connection header received
0808 08:52:09.057023 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:09.057028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:09.057117 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:09.057189 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:09.059088 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.060231 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.062265 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.062975 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.063077 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:09.069446 (+ 6369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:09.069461 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:09.069478 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:09.069527 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:09.072774 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.073589 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.073595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.073597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.073735 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.074145 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.074150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.074153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.074708 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:09.075102 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:09.075446 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 08:52:09.075604 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:52:09.076679 6680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:09.180260 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 6489
I20260808 08:52:09.203015 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 6700
Aug 08 08:52:09 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:52:09.221990 7175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:09.203885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58304 (local address 127.8.149.66:39533)
0808 08:52:09.204123 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:09.204133 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:09.204253 (+ 120us) server_negotiation.cc:407] Connection header received
0808 08:52:09.204471 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:09.204476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:09.204546 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:09.204631 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:09.206325 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.207081 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.209018 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.209448 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.209543 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:09.214648 (+ 5105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:09.214668 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:09.214685 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:09.214731 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:09.218416 (+ 3685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.219203 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.219213 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.219217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.219392 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.220147 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.220153 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.220157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.220735 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:09.221044 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:09.221349 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:52:09.221577 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:52:09.222640 6903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:09.357836 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 6700
I20260808 08:52:09.389788 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 6921
Aug 08 08:52:09 dist-test-slave-7vjv krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:52:09.407071 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:09.390658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49756 (local address 127.8.149.67:44493)
0808 08:52:09.390875 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:09.390883 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:09.390910 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:52:09.391107 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:09.391114 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:09.391217 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:09.391341 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:09.392741 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.393923 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.395201 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:09.395917 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:09.396053 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:09.400968 (+ 4915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:09.400981 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:09.400996 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:09.401025 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:09.404028 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.405094 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.405100 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.405103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.405243 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:09.405647 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:09.405652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:09.405654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:09.405990 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:09.406201 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:09.406590 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 08:52:09.406736 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:52:09.407740 7128 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:09.528864 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 6921
I20260808 08:52:09.552309 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 6327
I20260808 08:52:09.553539 6432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:09.682497 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 6327
2026-08-08T08:52:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4900 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T08:52:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:09Z Disabled control of system clock
I20260808 08:52:09.777434 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:37099
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:37099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:10.110581 7227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:10.110844 7227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:10.111004 7227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:10.117949 7227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:10.118083 7227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:10.118153 7227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:10.118261 7227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:10.118357 7227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:10.126868 7227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:37099
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:37099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:10.128011 7227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:10.129848 7227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:10.141306 7238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:10.141364 7235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:10.141377 7233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:10.142402 7227 server_base.cc:1034] running on GCE node
I20260808 08:52:10.143162 7227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:10.144488 7227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:10.145709 7227 hybrid_clock.cc:648] HybridClock initialized: now 1786179130145654 us; error 46 us; skew 500 ppm
I20260808 08:52:10.146090 7227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:10.148264 7227 webserver.cc:460] Webserver started at http://127.8.149.126:38649/ using document root <none> and password file <none>
I20260808 08:52:10.148923 7227 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:10.149011 7227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:10.149330 7227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:10.151969 7227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "73182b3cc1324215a3906beb71fef6b6"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "2a590f6a8e807a98656e5e5ae7d6eef8"
server_key_iv: "210542207550b5e8f487e5c5d7bf5006"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.152802 7227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "73182b3cc1324215a3906beb71fef6b6"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "2a590f6a8e807a98656e5e5ae7d6eef8"
server_key_iv: "210542207550b5e8f487e5c5d7bf5006"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.157614 7227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 08:52:10.160861 7249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:10.162158 7227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:52:10.162324 7227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "73182b3cc1324215a3906beb71fef6b6"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "2a590f6a8e807a98656e5e5ae7d6eef8"
server_key_iv: "210542207550b5e8f487e5c5d7bf5006"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.162516 7227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:10.175011 7227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:10.175714 7227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:10.176009 7227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:10.194931 7227 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:37099
I20260808 08:52:10.194968 7333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:37099 every 8 connection(s)
I20260808 08:52:10.196201 7227 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:10.199565 7334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:10.200410 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 7227
I20260808 08:52:10.200614 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:10.201052 8789 external_mini_cluster.cc:1428] Setting key 00732540a4aa50b24f447470cdfcc4d2
I20260808 08:52:10.212656 7334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: Bootstrap starting.
I20260808 08:52:10.214244 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:10.202839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39574 (local address 127.8.149.126:37099)
0808 08:52:10.204022 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:10.204031 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:10.204074 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:52:10.205667 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:10.205685 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:10.206106 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:10.206420 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:10.207041 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.208295 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.210165 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.210791 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.210911 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:10.212082 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:10.212130 (+ 48us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:10.212154 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:10.212631 (+ 477us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:10.212702 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:10.212721 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:10.212840 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:10.213100 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 08:52:10.213349 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":478,"threads_started":1}
I20260808 08:52:10.215793 7334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:10.216956 7334 log.cc:824] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:10.219460 7334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: No bootstrap required, opened a new log
I20260808 08:52:10.226493 7334 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } }
I20260808 08:52:10.226800 7334 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:10.226869 7334 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73182b3cc1324215a3906beb71fef6b6, State: Initialized, Role: FOLLOWER
I20260808 08:52:10.227306 7334 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } }
I20260808 08:52:10.227550 7334 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:10.227660 7334 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:10.227766 7334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:10.230043 7334 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } }
I20260808 08:52:10.230458 7334 leader_election.cc:302] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73182b3cc1324215a3906beb71fef6b6; no voters:
I20260808 08:52:10.230926 7334 leader_election.cc:288] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:10.231073 7343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:10.231813 7343 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [term 1 LEADER]: Becoming Leader. State: Replica: 73182b3cc1324215a3906beb71fef6b6, State: Running, Role: LEADER
I20260808 08:52:10.232364 7343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } }
I20260808 08:52:10.232836 7334 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:10.235193 7345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73182b3cc1324215a3906beb71fef6b6. Latest consensus state: current_term: 1 leader_uuid: "73182b3cc1324215a3906beb71fef6b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } } }
I20260808 08:52:10.235571 7345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:10.235114 7344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73182b3cc1324215a3906beb71fef6b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73182b3cc1324215a3906beb71fef6b6" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 37099 } } }
I20260808 08:52:10.235962 7344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:10.244128 7356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:10.248181 7356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:10.255784 7356 catalog_manager.cc:1347] Generated new cluster ID: dfed95860aca478c86ee9a9f1aa158e7
I20260808 08:52:10.255908 7356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:10.300781 7356 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:10.302223 7356 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:10.313941 7356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: Generated new TSK 0
I20260808 08:52:10.314764 7356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:10.322049 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--builtin_ntp_servers=127.8.149.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:10.659900 7370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:10.660256 7370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:10.660408 7370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:10.667479 7370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:10.667596 7370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:10.667778 7370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:52:10.675956 7370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:10.677098 7370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:10.678683 7370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:10.691810 7380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:10.691905 7376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:10.691928 7378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:10.692822 7370 server_base.cc:1034] running on GCE node
I20260808 08:52:10.693379 7370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:10.694263 7370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:10.695474 7370 hybrid_clock.cc:648] HybridClock initialized: now 1786179130695436 us; error 39 us; skew 500 ppm
I20260808 08:52:10.695787 7370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:10.698032 7370 webserver.cc:460] Webserver started at http://127.8.149.65:41217/ using document root <none> and password file <none>
I20260808 08:52:10.698675 7370 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:10.698786 7370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:10.699116 7370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:10.701889 7370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "5132ceab8c54d85ec6dd8cccf88a0378"
server_key_iv: "5659d3d6ba3142e6f9c7664e60998055"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.702643 7370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "5132ceab8c54d85ec6dd8cccf88a0378"
server_key_iv: "5659d3d6ba3142e6f9c7664e60998055"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.707648 7370 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:52:10.711066 7387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:10.712437 7370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:52:10.712625 7370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba"
format_stamp: "Formatted at 2026-08-08 08:52:10 on dist-test-slave-7vjv"
server_key: "5132ceab8c54d85ec6dd8cccf88a0378"
server_key_iv: "5659d3d6ba3142e6f9c7664e60998055"
server_key_version: "encryptionkey@0"
I20260808 08:52:10.712857 7370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:10.731864 7370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:10.732851 7370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:10.733213 7370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:10.734397 7370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:10.735891 7370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:10.736065 7370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:10.736227 7370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:10.736336 7370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:10.769004 7370 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:46067
I20260808 08:52:10.769042 7576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:46067 every 8 connection(s)
I20260808 08:52:10.770406 7370 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:52:10.777598 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 7370
I20260808 08:52:10.777789 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:52:10.778415 8789 external_mini_cluster.cc:1428] Setting key 7b18e481a67ef274ecf7a6e6d2a02952
I20260808 08:52:10.781208 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--builtin_ntp_servers=127.8.149.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:10.782980 7579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:10.773088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:52149 (local address 127.8.149.126:37099)
0808 08:52:10.773552 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:10.773558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:10.774849 (+ 1291us) server_negotiation.cc:407] Connection header received
0808 08:52:10.776490 (+ 1641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:10.776495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:10.776561 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:10.776662 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:10.777650 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.778702 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.780269 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.780701 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.780844 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:10.782194 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:10.782200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:10.782203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:10.782219 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:10.782255 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:10.782266 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:10.782370 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:10.782573 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 08:52:10.782662 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":205,"threads_started":1}
I20260808 08:52:10.783780 7580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:10.773757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:37099 (local address 127.8.149.65:52149)
0808 08:52:10.774707 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:10.774746 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:10.776251 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:10.776822 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:10.776829 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:10.776916 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:10.777476 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:10.777492 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.778844 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.778847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:10.780039 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:10.780050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:10.780950 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:10.780959 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:10.781165 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:10.781871 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:10.781874 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:10.781934 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:10.782006 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:10.782368 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:10.782380 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:10.782389 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:52:10.782559 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 08:52:10.782883 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":367,"threads_started":1}
I20260808 08:52:10.785127 7577 heartbeater.cc:347] Connected to a master server at 127.8.149.126:37099
I20260808 08:52:10.785419 7577 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:10.786188 7577 heartbeater.cc:511] Master 127.8.149.126:37099 requested a full tablet report, sending...
I20260808 08:52:10.788237 7272 ts_manager.cc:194] Registered new tserver with Master: 9792e5ec925d4b08a9d9c5f7ff61a3ba (127.8.149.65:46067)
I20260808 08:52:10.790001 7272 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.65:52149
W20260808 08:52:11.107967 7583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:11.108240 7583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:11.108412 7583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:11.114827 7583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:11.114907 7583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:11.115062 7583 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:11.123198 7583 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:11.124298 7583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:11.125969 7583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:11.139413 7590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:11.139434 7594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:11.139501 7596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:11.140386 7583 server_base.cc:1034] running on GCE node
I20260808 08:52:11.141003 7583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:11.141899 7583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:11.143162 7583 hybrid_clock.cc:648] HybridClock initialized: now 1786179131143117 us; error 51 us; skew 500 ppm
I20260808 08:52:11.143527 7583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:11.145918 7583 webserver.cc:460] Webserver started at http://127.8.149.66:36741/ using document root <none> and password file <none>
I20260808 08:52:11.146629 7583 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:11.146764 7583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:11.147123 7583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:11.150061 7583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "1e66811f472e4a16bb1f6ddacca94cfc"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "db514b2e4d1d070fde489623e043f54c"
server_key_iv: "fc5d822406e78cd3147462d0e60c1b1e"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.150867 7583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "1e66811f472e4a16bb1f6ddacca94cfc"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "db514b2e4d1d070fde489623e043f54c"
server_key_iv: "fc5d822406e78cd3147462d0e60c1b1e"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.156157 7583 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:52:11.159523 7610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.160818 7583 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:11.161049 7583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "1e66811f472e4a16bb1f6ddacca94cfc"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "db514b2e4d1d070fde489623e043f54c"
server_key_iv: "fc5d822406e78cd3147462d0e60c1b1e"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.161257 7583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:11.180881 7583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:11.181644 7583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:11.181962 7583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:11.182888 7583 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:11.184378 7583 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:11.184499 7583 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.184625 7583 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:11.184710 7583 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.219302 7583 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:38067
I20260808 08:52:11.219388 7788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:38067 every 8 connection(s)
I20260808 08:52:11.220568 7583 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:11.222859 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 7583
I20260808 08:52:11.223039 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:11.223513 8789 external_mini_cluster.cc:1428] Setting key f17b610467372d25f462bc09ca69df66
I20260808 08:52:11.226315 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--builtin_ntp_servers=127.8.149.84:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:11.233609 7579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.222966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:47985 (local address 127.8.149.126:37099)
0808 08:52:11.223182 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.223190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.224736 (+ 1546us) server_negotiation.cc:407] Connection header received
0808 08:52:11.226347 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.226352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.226438 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.226550 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:11.228045 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.228843 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.230996 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.231371 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.231478 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.232976 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:11.232980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:11.232983 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:11.232999 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:11.233028 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:11.233039 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:11.233106 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.233326 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.233393 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:52:11.234877 7793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.223470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:37099 (local address 127.8.149.66:47985)
0808 08:52:11.224595 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:11.224637 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:11.226066 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:11.226972 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:11.226984 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:11.227099 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:11.227851 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.227878 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.229002 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.229009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.230847 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.230863 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.231578 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.231588 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.231935 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.232644 (+ 709us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:11.232649 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:11.232694 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:11.232786 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:11.233131 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:11.233142 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:11.233152 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:52:11.233311 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 08:52:11.233669 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":380,"threads_started":1}
I20260808 08:52:11.236334 7789 heartbeater.cc:347] Connected to a master server at 127.8.149.126:37099
I20260808 08:52:11.236613 7789 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:11.237439 7789 heartbeater.cc:511] Master 127.8.149.126:37099 requested a full tablet report, sending...
I20260808 08:52:11.238870 7272 ts_manager.cc:194] Registered new tserver with Master: 1e66811f472e4a16bb1f6ddacca94cfc (127.8.149.66:38067)
I20260808 08:52:11.240028 7272 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.66:47985
W20260808 08:52:11.553588 7795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:11.553900 7795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:11.554019 7795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:11.560930 7795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:11.561020 7795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:11.561117 7795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:11.569486 7795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:37099
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:11.570554 7795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:11.572343 7795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:11.584971 7806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:11.585124 7805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:11.585248 7811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:11.586061 7795 server_base.cc:1034] running on GCE node
I20260808 08:52:11.586676 7795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:11.587605 7795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:11.588840 7795 hybrid_clock.cc:648] HybridClock initialized: now 1786179131588779 us; error 47 us; skew 500 ppm
I20260808 08:52:11.589177 7795 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:11.591336 7795 webserver.cc:460] Webserver started at http://127.8.149.67:32865/ using document root <none> and password file <none>
I20260808 08:52:11.592078 7795 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:11.592289 7795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:11.592638 7795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:11.595418 7795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "8ca198912a854dfa996d061556326b63"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "51b8e362b53c85c7f7514c1686fb3b2d"
server_key_iv: "dcd022567e46cd3066fd289c1f68e501"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.596319 7795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "8ca198912a854dfa996d061556326b63"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "51b8e362b53c85c7f7514c1686fb3b2d"
server_key_iv: "dcd022567e46cd3066fd289c1f68e501"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.601454 7795 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:52:11.604926 7822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.606182 7795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:52:11.606374 7795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "8ca198912a854dfa996d061556326b63"
format_stamp: "Formatted at 2026-08-08 08:52:11 on dist-test-slave-7vjv"
server_key: "51b8e362b53c85c7f7514c1686fb3b2d"
server_key_iv: "dcd022567e46cd3066fd289c1f68e501"
server_key_version: "encryptionkey@0"
I20260808 08:52:11.606616 7795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:11.631665 7795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:11.632458 7795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:11.632861 7795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:11.633816 7795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:11.635258 7795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:11.635404 7795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.635550 7795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:11.635658 7795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:11.669997 7795 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:43435
I20260808 08:52:11.670076 8010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:43435 every 8 connection(s)
I20260808 08:52:11.671312 7795 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:11.678009 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 7795
I20260808 08:52:11.678202 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:11.678699 8789 external_mini_cluster.cc:1428] Setting key 7b92c9489f16afeddd7b663cacd11107
I20260808 08:52:11.683621 7579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.673740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:57045 (local address 127.8.149.126:37099)
0808 08:52:11.673908 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.673914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.675136 (+ 1222us) server_negotiation.cc:407] Connection header received
0808 08:52:11.677047 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.677053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.677141 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.677252 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:11.678511 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.679410 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.681291 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.681789 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.681883 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.683049 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:11.683053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:11.683056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:11.683071 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:11.683098 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:11.683107 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:11.683170 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.683341 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.683407 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:52:11.684526 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.674145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:37099 (local address 127.8.149.67:57045)
0808 08:52:11.674990 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:11.675026 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:11.676762 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:11.677456 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:11.677463 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:11.677544 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:11.678328 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.678355 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.679543 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.679549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.681084 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.681095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.681992 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.681997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.682170 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.682792 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:11.682795 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:11.682828 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:11.682901 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:11.683184 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:11.683192 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:11.683197 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:52:11.683315 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:52:11.683558 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":275,"threads_started":1}
I20260808 08:52:11.685693 8011 heartbeater.cc:347] Connected to a master server at 127.8.149.126:37099
I20260808 08:52:11.685977 8011 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:11.686616 8011 heartbeater.cc:511] Master 127.8.149.126:37099 requested a full tablet report, sending...
I20260808 08:52:11.687925 7272 ts_manager.cc:194] Registered new tserver with Master: 8ca198912a854dfa996d061556326b63 (127.8.149.67:43435)
I20260808 08:52:11.688755 7272 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.67:57045
I20260808 08:52:11.693382 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:11.703088 7579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.697223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39586 (local address 127.8.149.126:37099)
0808 08:52:11.697374 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.697378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.697831 (+ 453us) server_negotiation.cc:407] Connection header received
0808 08:52:11.698012 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.698017 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.698094 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.698188 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:11.698657 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.699333 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.700803 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.701213 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.701341 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.702401 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:11.702406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:11.702410 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:11.702433 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:11.702460 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:11.702470 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:11.702614 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.702789 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.702836 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:52:11.706849 7272 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:11.713774 7272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:11.750283 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.727174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38067 (local address 127.0.0.1:53946)
0808 08:52:11.741335 (+ 14161us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:11.741358 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:11.741499 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:11.742910 (+ 1411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:11.742914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:11.742944 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:11.743365 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.743377 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.745187 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.745209 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.747103 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.747116 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.749272 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.749278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.749470 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.749519 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 08:52:11.749642 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:52:11.749829 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14007,"mutex_wait_us":73,"thread_start_us":10443,"threads_started":1}
I20260808 08:52:11.750579 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.727473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53946 (local address 127.8.149.66:38067)
0808 08:52:11.742136 (+ 14663us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.742146 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.742177 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:52:11.742279 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.742286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.742512 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.742721 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:11.743606 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.745054 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.747296 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.748758 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.748906 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.749136 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.750042 (+ 906us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.750251 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14480,"thread_start_us":15391,"threads_started":1}
I20260808 08:52:11.750710 8033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.725423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54578 (local address 127.8.149.67:43435)
0808 08:52:11.742975 (+ 17552us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.742983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.743011 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:52:11.743129 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.743135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.743306 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.743515 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:11.744190 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.745784 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.748189 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.749477 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.749636 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.749909 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.750207 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.750354 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17368,"thread_start_us":17215,"threads_started":1}
I20260808 08:52:11.750954 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.725678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56786 (local address 127.8.149.65:46067)
0808 08:52:11.741563 (+ 15885us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:11.741575 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:11.741614 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:52:11.741753 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:11.741763 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:11.742030 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:11.742257 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:11.743092 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.744771 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.747582 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.749145 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.749277 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.749532 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:11.750387 (+ 855us) server_negotiation.cc:299] Negotiation successful
0808 08:52:11.750566 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15712,"thread_start_us":15918,"threads_started":1}
I20260808 08:52:11.751292 8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.725451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:46067 (local address 127.0.0.1:56786)
0808 08:52:11.737877 (+ 12426us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:11.737906 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:11.738049 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:11.742313 (+ 4264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:11.742324 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:11.742366 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:11.742845 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.742863 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.744949 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.744954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.747378 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.747393 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.749713 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.749720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.749884 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.749966 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 08:52:11.750048 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 08:52:11.750195 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12285,"mutex_wait_us":166,"thread_start_us":15530,"threads_started":1}
I20260808 08:52:11.751387 8030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:11.725134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:43435 (local address 127.0.0.1:54578)
0808 08:52:11.726202 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:11.726271 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:11.726480 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:11.743507 (+ 17027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:11.743512 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:11.743539 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:11.743906 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.743960 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.745939 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.745944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.747979 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:11.747989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:11.749740 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:11.749747 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:11.749977 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:11.750008 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:52:11.750096 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 08:52:11.750970 (+ 874us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":857,"thread_start_us":726,"threads_started":1}
I20260808 08:52:11.754557 7465 tablet_service.cc:1467] Processing CreateTablet for tablet dc2d09f54bc34750a767b6868515c59b (DEFAULT_TABLE table=test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:11.754709 7687 tablet_service.cc:1467] Processing CreateTablet for tablet dc2d09f54bc34750a767b6868515c59b (DEFAULT_TABLE table=test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:11.755817 7465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2d09f54bc34750a767b6868515c59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:11.755352 7898 tablet_service.cc:1467] Processing CreateTablet for tablet dc2d09f54bc34750a767b6868515c59b (DEFAULT_TABLE table=test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:11.756130 7687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2d09f54bc34750a767b6868515c59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:11.756686 7898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc2d09f54bc34750a767b6868515c59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:11.767288 8038 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Bootstrap starting.
I20260808 08:52:11.769963 8039 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Bootstrap starting.
I20260808 08:52:11.771390 8040 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Bootstrap starting.
I20260808 08:52:11.773298 8039 tablet_bootstrap.cc:654] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:11.774300 8040 tablet_bootstrap.cc:654] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:11.774449 8039 log.cc:824] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:11.775497 8040 log.cc:824] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:11.780357 8038 tablet_bootstrap.cc:654] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:11.783128 8038 log.cc:824] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:11.784821 8040 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: No bootstrap required, opened a new log
I20260808 08:52:11.785156 8040 ts_tablet_manager.cc:1397] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.011s
I20260808 08:52:11.786190 8039 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: No bootstrap required, opened a new log
I20260808 08:52:11.786458 8039 ts_tablet_manager.cc:1397] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260808 08:52:11.790655 8038 tablet_bootstrap.cc:492] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: No bootstrap required, opened a new log
I20260808 08:52:11.790922 8038 ts_tablet_manager.cc:1397] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.006s
I20260808 08:52:11.793336 7577 heartbeater.cc:503] Master 127.8.149.126:37099 was elected leader, sending a full tablet report...
I20260808 08:52:11.794579 8039 raft_consensus.cc:348] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.795022 8039 raft_consensus.cc:374] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:11.795125 8039 raft_consensus.cc:729] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e66811f472e4a16bb1f6ddacca94cfc, State: Initialized, Role: FOLLOWER
I20260808 08:52:11.795815 8039 consensus_queue.cc:260] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.795924 8040 raft_consensus.cc:348] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.796393 8040 raft_consensus.cc:374] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:11.796483 8040 raft_consensus.cc:729] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca198912a854dfa996d061556326b63, State: Initialized, Role: FOLLOWER
I20260808 08:52:11.797531 8040 consensus_queue.cc:260] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.799242 8011 heartbeater.cc:503] Master 127.8.149.126:37099 was elected leader, sending a full tablet report...
I20260808 08:52:11.799744 7789 heartbeater.cc:503] Master 127.8.149.126:37099 was elected leader, sending a full tablet report...
I20260808 08:52:11.799774 8040 ts_tablet_manager.cc:1428] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260808 08:52:11.801597 8039 ts_tablet_manager.cc:1428] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260808 08:52:11.801476 8038 raft_consensus.cc:348] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.801837 8038 raft_consensus.cc:374] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:11.801952 8038 raft_consensus.cc:729] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9792e5ec925d4b08a9d9c5f7ff61a3ba, State: Initialized, Role: FOLLOWER
I20260808 08:52:11.802506 8038 consensus_queue.cc:260] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:11.804549 8038 ts_tablet_manager.cc:1428] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
W20260808 08:52:11.923072 8013 tablet.cc:2369] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:11.972541 7792 tablet.cc:2369] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:52:12.023038 7578 tablet.cc:2369] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:52:12.059181 8050 raft_consensus.cc:482] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:12.059543 8050 raft_consensus.cc:504] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:12.061304 8050 leader_election.cc:288] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9792e5ec925d4b08a9d9c5f7ff61a3ba (127.8.149.65:46067), 1e66811f472e4a16bb1f6ddacca94cfc (127.8.149.66:38067)
I20260808 08:52:12.068602 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.061859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:49299 (local address 127.8.149.66:38067)
0808 08:52:12.062067 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.062075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.062100 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:52:12.062343 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.062350 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.062441 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.062549 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:12.063149 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.064036 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.066600 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.067787 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.067949 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.068016 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.068244 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.068369 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:52:12.068681 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.061657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:38067 (local address 127.8.149.67:49299)
0808 08:52:12.061971 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:12.061998 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:12.062164 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:12.062644 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:12.062651 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:12.062721 (+ 70us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:12.062975 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:12.062989 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.064204 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.064209 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:12.066394 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:12.066406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.067921 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.067925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:12.068038 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.068084 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:52:12.068215 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 08:52:12.068354 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":159}
I20260808 08:52:12.068907 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.061780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42209 (local address 127.8.149.65:46067)
0808 08:52:12.061987 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.061994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.062619 (+ 625us) server_negotiation.cc:407] Connection header received
0808 08:52:12.062789 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.062795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.062888 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.062989 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:12.063604 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.064390 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.066802 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.068004 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.068202 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.068266 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.068531 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.068665 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:52:12.069203 8054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.061704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:46067 (local address 127.8.149.67:42209)
0808 08:52:12.062485 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:12.062509 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:12.062646 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:12.063006 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:12.063009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:12.063031 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:12.063445 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:12.063457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.064537 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.064540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:12.066627 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:12.066638 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.068194 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.068201 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:12.068362 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.068392 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:52:12.068492 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:52:12.068596 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":1,"thread_start_us":465,"threads_started":1}
I20260808 08:52:12.069952 7716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2d09f54bc34750a767b6868515c59b" candidate_uuid: "8ca198912a854dfa996d061556326b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" is_pre_election: true
I20260808 08:52:12.070248 7504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2d09f54bc34750a767b6868515c59b" candidate_uuid: "8ca198912a854dfa996d061556326b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" is_pre_election: true
I20260808 08:52:12.070441 7716 raft_consensus.cc:2454] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca198912a854dfa996d061556326b63 in term 0.
I20260808 08:52:12.070714 7504 raft_consensus.cc:2454] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ca198912a854dfa996d061556326b63 in term 0.
I20260808 08:52:12.071125 7827 leader_election.cc:302] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e66811f472e4a16bb1f6ddacca94cfc, 8ca198912a854dfa996d061556326b63; no voters:
I20260808 08:52:12.071473 8050 raft_consensus.cc:2781] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:12.071621 8050 raft_consensus.cc:482] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:12.071725 8050 raft_consensus.cc:3037] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:12.073943 8050 raft_consensus.cc:504] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:12.074505 8050 leader_election.cc:288] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [CANDIDATE]: Term 1 election: Requested vote from peers 9792e5ec925d4b08a9d9c5f7ff61a3ba (127.8.149.65:46067), 1e66811f472e4a16bb1f6ddacca94cfc (127.8.149.66:38067)
I20260808 08:52:12.074934 7504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2d09f54bc34750a767b6868515c59b" candidate_uuid: "8ca198912a854dfa996d061556326b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba"
I20260808 08:52:12.074957 7716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2d09f54bc34750a767b6868515c59b" candidate_uuid: "8ca198912a854dfa996d061556326b63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e66811f472e4a16bb1f6ddacca94cfc"
I20260808 08:52:12.075100 7504 raft_consensus.cc:3037] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:12.075145 7716 raft_consensus.cc:3037] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:12.077385 7504 raft_consensus.cc:2454] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca198912a854dfa996d061556326b63 in term 1.
I20260808 08:52:12.077521 7716 raft_consensus.cc:2454] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ca198912a854dfa996d061556326b63 in term 1.
I20260808 08:52:12.077800 7824 leader_election.cc:302] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ca198912a854dfa996d061556326b63, 9792e5ec925d4b08a9d9c5f7ff61a3ba; no voters:
I20260808 08:52:12.078125 8050 raft_consensus.cc:2781] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:12.078563 8050 raft_consensus.cc:686] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 1 LEADER]: Becoming Leader. State: Replica: 8ca198912a854dfa996d061556326b63, State: Running, Role: LEADER
I20260808 08:52:12.078990 8050 consensus_queue.cc:237] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } }
I20260808 08:52:12.083304 7272 catalog_manager.cc:5495] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ca198912a854dfa996d061556326b63 (127.8.149.67). New cstate: current_term: 1 leader_uuid: "8ca198912a854dfa996d061556326b63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ca198912a854dfa996d061556326b63" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 43435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:12.129468 8033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.124238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54584 (local address 127.8.149.67:43435)
0808 08:52:12.124408 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.124414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.124441 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:52:12.124534 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.124539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.124626 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.124774 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:12.125154 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.125843 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.127203 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.127626 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.127767 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.128438 (+ 671us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:12.128928 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:12.129112 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.129234 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.129277 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:52:12.137521 7716 raft_consensus.cc:1261] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 1 FOLLOWER]: Refusing update from remote peer 8ca198912a854dfa996d061556326b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:12.137521 7504 raft_consensus.cc:1261] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 1 FOLLOWER]: Refusing update from remote peer 8ca198912a854dfa996d061556326b63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:12.138579 8056 consensus_queue.cc:1035] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9792e5ec925d4b08a9d9c5f7ff61a3ba" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 46067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:12.138952 8050 consensus_queue.cc:1035] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e66811f472e4a16bb1f6ddacca94cfc" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:12.152667 8067 mvcc.cc:205] Tried to move back new op lower bound from 7316189725224972288 to 7316189724998893568. Current Snapshot: MvccSnapshot[applied={T|T < 7316189725224972288}]
I20260808 08:52:12.156188 8066 mvcc.cc:205] Tried to move back new op lower bound from 7316189725224972288 to 7316189724998893568. Current Snapshot: MvccSnapshot[applied={T|T < 7316189725224972288}]
I20260808 08:52:12.169332 7271 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:12.169647 7271 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:12.173512 7271 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73182b3cc1324215a3906beb71fef6b6: Sending DeleteTablet for 3 replicas of tablet dc2d09f54bc34750a767b6868515c59b
I20260808 08:52:12.174520 7465 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2d09f54bc34750a767b6868515c59b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:12 UTC) from {username='slave'} at 127.0.0.1:56786
I20260808 08:52:12.174557 7898 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2d09f54bc34750a767b6868515c59b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:12 UTC) from {username='slave'} at 127.0.0.1:54578
I20260808 08:52:12.175294 8079 tablet_replica.cc:330] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: stopping tablet replica
I20260808 08:52:12.175685 8079 raft_consensus.cc:2229] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:12.175837 7687 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2d09f54bc34750a767b6868515c59b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:12 UTC) from {username='slave'} at 127.0.0.1:53946
I20260808 08:52:12.176353 8079 raft_consensus.cc:2258] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:12.177450 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 7370
I20260808 08:52:12.178992 8079 ts_tablet_manager.cc:1905] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:12.188180 8079 ts_tablet_manager.cc:1918] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:12.188791 8083 tablet_replica.cc:330] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: stopping tablet replica
I20260808 08:52:12.189122 8083 raft_consensus.cc:2229] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:12.189553 8083 raft_consensus.cc:2258] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:12.189914 8079 log.cc:1196] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/dc2d09f54bc34750a767b6868515c59b
I20260808 08:52:12.190353 8079 ts_tablet_manager.cc:1939] T dc2d09f54bc34750a767b6868515c59b P 9792e5ec925d4b08a9d9c5f7ff61a3ba: Deleting consensus metadata
I20260808 08:52:12.191767 7252 catalog_manager.cc:4841] TS 9792e5ec925d4b08a9d9c5f7ff61a3ba (127.8.149.65:46067): tablet dc2d09f54bc34750a767b6868515c59b (table test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]) successfully deleted
I20260808 08:52:12.192975 8083 ts_tablet_manager.cc:1905] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:12.198799 8083 ts_tablet_manager.cc:1918] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:12.198935 8083 log.cc:1196] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/dc2d09f54bc34750a767b6868515c59b
I20260808 08:52:12.199466 8083 ts_tablet_manager.cc:1939] T dc2d09f54bc34750a767b6868515c59b P 1e66811f472e4a16bb1f6ddacca94cfc: Deleting consensus metadata
I20260808 08:52:12.201006 7255 catalog_manager.cc:4841] TS 1e66811f472e4a16bb1f6ddacca94cfc (127.8.149.66:38067): tablet dc2d09f54bc34750a767b6868515c59b (table test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]) successfully deleted
I20260808 08:52:12.212271 8082 tablet_replica.cc:330] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: stopping tablet replica
I20260808 08:52:12.212698 8082 raft_consensus.cc:2229] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:12.213349 8082 raft_consensus.cc:2258] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:12.215281 8082 ts_tablet_manager.cc:1905] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:12.219537 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.178887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56800 (local address 127.8.149.65:46067)
0808 08:52:12.179060 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.179067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.205254 (+ 26187us) server_negotiation.cc:407] Connection header received
0808 08:52:12.205536 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.205542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.205670 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.205769 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:12.206571 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.208038 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.210275 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.210931 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.211053 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.217237 (+ 6184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:12.217250 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:12.217268 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:12.218079 (+ 811us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:12.218140 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:12.218168 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:12.218299 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.219028 (+ 729us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.219145 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:52:12.220850 7571 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:12.222764 8082 ts_tablet_manager.cc:1918] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:12.222891 8082 log.cc:1196] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/dc2d09f54bc34750a767b6868515c59b
I20260808 08:52:12.223400 8082 ts_tablet_manager.cc:1939] T dc2d09f54bc34750a767b6868515c59b P 8ca198912a854dfa996d061556326b63: Deleting consensus metadata
I20260808 08:52:12.224922 7255 catalog_manager.cc:4841] TS 8ca198912a854dfa996d061556326b63 (127.8.149.67:43435): tablet dc2d09f54bc34750a767b6868515c59b (table test-table [id=d6faaaf5fb764175b1945ab9dfe26e50]) successfully deleted
I20260808 08:52:12.316879 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 7370
I20260808 08:52:12.344316 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 7583
I20260808 08:52:12.351580 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.345077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53960 (local address 127.8.149.66:38067)
0808 08:52:12.345241 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.345245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.345261 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:52:12.345451 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.345454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.345551 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.345640 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:12.346063 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.346713 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.348532 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.348946 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.349032 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.350209 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:12.350218 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:12.350231 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:12.350786 (+ 555us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:12.350832 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:12.350850 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:12.350948 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.351104 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.351243 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:52:12.352329 7782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:12.435612 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 7583
I20260808 08:52:12.468214 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 7795
I20260808 08:52:12.475191 8033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:12.469068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.8.149.67:43435)
0808 08:52:12.469270 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:12.469294 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:12.469313 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:52:12.469465 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:12.469470 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:12.469573 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:12.469675 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:12.470096 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.470893 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.472129 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:12.472545 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:12.472680 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:12.473851 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:12.473859 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:12.473872 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:12.474448 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:12.474496 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:12.474515 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:12.474587 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:12.474769 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 08:52:12.474838 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:52:12.475900 7997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:12.594626 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 7795
I20260808 08:52:12.624712 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 7227
I20260808 08:52:12.625710 7322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:12.729446 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 7227
2026-08-08T08:52:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3044 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:12 dist-test-slave-7vjv krb5kdc[8095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:12 dist-test-slave-7vjv krb5kdc[8095](info): set up 2 sockets
Aug 08 08:52:12 dist-test-slave-7vjv krb5kdc[8095](info): commencing operation
krb5kdc: starting...
W20260808 08:52:14.022390 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:14 dist-test-slave-7vjv krb5kdc[8095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:14.307554 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40521
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:14.644671 8117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:14.644969 8117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:14.645143 8117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:14.651849 8117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:14.651988 8117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:14.652154 8117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:14.652253 8117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:14.652344 8117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:14.661381 8117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:14.662549 8117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:14.663786 8117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:14.674782 8122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:14.674822 8123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:14.674788 8125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:14.675668 8117 server_base.cc:1034] running on GCE node
I20260808 08:52:14.676492 8117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:14.677793 8117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:14.679029 8117 hybrid_clock.cc:648] HybridClock initialized: now 1786179134678989 us; error 68 us; skew 500 ppm
I20260808 08:52:14.679355 8117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:14 dist-test-slave-7vjv krb5kdc[8095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:14.682680 8117 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:14.684084 8117 webserver.cc:460] Webserver started at http://127.8.149.126:44767/ using document root <none> and password file <none>
I20260808 08:52:14.684748 8117 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:14.684849 8117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:14.685101 8117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:14.687829 8117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "f219dbcd72ac4174a8ced460fd3b75d1"
format_stamp: "Formatted at 2026-08-08 08:52:14 on dist-test-slave-7vjv"
server_key: "68910b762136350b5d8fc86d15ae5dc1"
server_key_iv: "d4785a2463f1205710ecf381993e2eef"
server_key_version: "encryptionkey@0"
I20260808 08:52:14.688681 8117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "f219dbcd72ac4174a8ced460fd3b75d1"
format_stamp: "Formatted at 2026-08-08 08:52:14 on dist-test-slave-7vjv"
server_key: "68910b762136350b5d8fc86d15ae5dc1"
server_key_iv: "d4785a2463f1205710ecf381993e2eef"
server_key_version: "encryptionkey@0"
I20260808 08:52:14.693687 8117 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 08:52:14.697220 8138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:14.698627 8117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:52:14.698823 8117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "f219dbcd72ac4174a8ced460fd3b75d1"
format_stamp: "Formatted at 2026-08-08 08:52:14 on dist-test-slave-7vjv"
server_key: "68910b762136350b5d8fc86d15ae5dc1"
server_key_iv: "d4785a2463f1205710ecf381993e2eef"
server_key_version: "encryptionkey@0"
I20260808 08:52:14.699031 8117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:14.718652 8117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:14.722533 8117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:14.722832 8117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:14.741266 8117 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40521
I20260808 08:52:14.741288 8234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40521 every 8 connection(s)
I20260808 08:52:14.742587 8117 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:14.743655 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 8117
I20260808 08:52:14.743842 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:14.745898 8789 external_mini_cluster.cc:1428] Setting key 42bb215c0b1c1f2177a5e2473f8477eb
I20260808 08:52:14.747360 8235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:52:14 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:14.761348 8235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: Bootstrap starting.
I20260808 08:52:14.764582 8235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:14.765614 8235 log.cc:824] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:14.768370 8235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: No bootstrap required, opened a new log
I20260808 08:52:14.769279 8241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:14.747730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47396 (local address 127.8.149.126:40521)
0808 08:52:14.748550 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:14.748561 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:14.748597 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:52:14.750187 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:14.750207 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:14.750567 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:14.750877 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:14.752781 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:14.754180 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:14.756049 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:14.756800 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:14.756934 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:14.761812 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:14.761819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:14.761838 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:14.761878 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:14.765187 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:14.765965 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:14.765971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:14.765977 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:14.766146 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:14.766567 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:14.766581 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:14.766584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:14.767112 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:14.767416 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:14.767863 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 08:52:14.768292 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":421,"threads_started":1}
I20260808 08:52:14.776054 8235 raft_consensus.cc:348] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } }
I20260808 08:52:14.776469 8235 raft_consensus.cc:374] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:14.776577 8235 raft_consensus.cc:729] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f219dbcd72ac4174a8ced460fd3b75d1, State: Initialized, Role: FOLLOWER
I20260808 08:52:14.777128 8235 consensus_queue.cc:260] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } }
I20260808 08:52:14.777385 8235 raft_consensus.cc:388] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:14.777526 8235 raft_consensus.cc:482] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:14.777729 8235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:14.780146 8235 raft_consensus.cc:504] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } }
I20260808 08:52:14.780570 8235 leader_election.cc:302] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f219dbcd72ac4174a8ced460fd3b75d1; no voters:
I20260808 08:52:14.781124 8235 leader_election.cc:288] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:14.781301 8245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:14.782023 8245 raft_consensus.cc:686] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [term 1 LEADER]: Becoming Leader. State: Replica: f219dbcd72ac4174a8ced460fd3b75d1, State: Running, Role: LEADER
I20260808 08:52:14.782662 8245 consensus_queue.cc:237] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } }
I20260808 08:52:14.783196 8235 sys_catalog.cc:564] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:14.785473 8249 sys_catalog.cc:455] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f219dbcd72ac4174a8ced460fd3b75d1. Latest consensus state: current_term: 1 leader_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } } }
I20260808 08:52:14.785908 8249 sys_catalog.cc:458] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:14.786831 8246 sys_catalog.cc:455] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f219dbcd72ac4174a8ced460fd3b75d1" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40521 } } }
I20260808 08:52:14.787734 8246 sys_catalog.cc:458] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:14.790189 8257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:14.795079 8257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:14.803226 8257 catalog_manager.cc:1347] Generated new cluster ID: 6fccb3263a4a4960af3cca73fa03acbb
I20260808 08:52:14.803357 8257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:14.825776 8257 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:14.827625 8257 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:14.839109 8257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: Generated new TSK 0
I20260808 08:52:14.839969 8257 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.8.149.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
Entry for principal kudu/127.8.149.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab.
I20260808 08:52:14.913793 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:15.242228 8281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:15.242535 8281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:15.242712 8281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:15.249647 8281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:15.249782 8281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:15.249958 8281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:52:15.259169 8281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.65.keytab
--principal=kudu/127.8.149.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:15.260424 8281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:15.261665 8281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:15.274097 8287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:15.274068 8296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:15.274024 8289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:15.274786 8281 server_base.cc:1034] running on GCE node
I20260808 08:52:15.275406 8281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:15.276345 8281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:15.277542 8281 hybrid_clock.cc:648] HybridClock initialized: now 1786179135277505 us; error 31 us; skew 500 ppm
I20260808 08:52:15.277858 8281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:15 dist-test-slave-7vjv krb5kdc[8095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:15.281189 8281 init.cc:377] Logged in from keytab as kudu/127.8.149.65@KRBTEST.COM (short username kudu)
I20260808 08:52:15.282580 8281 webserver.cc:460] Webserver started at http://127.8.149.65:41297/ using document root <none> and password file <none>
I20260808 08:52:15.283273 8281 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:15.283447 8281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:15.283808 8281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:15.286836 8281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "993514baf0de2250dccb7dbed6943c4e"
server_key_iv: "205f34ff12eddc1db0330b539e855949"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.287678 8281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "993514baf0de2250dccb7dbed6943c4e"
server_key_iv: "205f34ff12eddc1db0330b539e855949"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.292976 8281 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 08:52:15.296310 8307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.297410 8281 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 08:52:15.297574 8281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "993514baf0de2250dccb7dbed6943c4e"
server_key_iv: "205f34ff12eddc1db0330b539e855949"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.297755 8281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:15.316444 8281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:15.320600 8281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:15.320880 8281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:15.321761 8281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:15.322975 8281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:15.323074 8281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.323244 8281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:15.323318 8281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.359663 8281 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:40157
I20260808 08:52:15.359704 8487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:40157 every 8 connection(s)
I20260808 08:52:15.361056 8281 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:52:15.369284 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 8281
I20260808 08:52:15.369445 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:52:15.369853 8789 external_mini_cluster.cc:1428] Setting key b31f3e90daf4087af6e15794fcbe1664
Aug 08 08:52:15 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.65@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:15.383708 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:15.363578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:43981 (local address 127.8.149.126:40521)
0808 08:52:15.364081 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:15.364087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:15.365126 (+ 1039us) server_negotiation.cc:407] Connection header received
0808 08:52:15.367001 (+ 1875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:15.367008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:15.367102 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:15.367232 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:15.368921 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.369745 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.371759 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.372322 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.372473 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:15.376492 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:15.376500 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:15.376507 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:15.376547 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:15.379962 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:15.380934 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:15.380942 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:15.380948 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:15.381114 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:15.381653 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:15.381660 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:15.381666 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:15.382025 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:15.382182 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:15.383108 (+ 926us) server_negotiation.cc:299] Negotiation successful
0808 08:52:15.383283 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":265,"threads_started":1}
I20260808 08:52:15.385144 8492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:15.364187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40521 (local address 127.8.149.65:43981)
0808 08:52:15.364958 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:15.365009 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:15.366709 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:15.367506 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:15.367515 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:15.368168 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:15.368716 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:15.368755 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.369919 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.369922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:15.371616 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:15.371635 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.372553 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.372558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:15.372743 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:15.373469 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:15.373495 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:15.376280 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:15.380144 (+ 3864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:15.380154 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:15.380170 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:15.380786 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:15.381266 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:15.381273 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:15.381279 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:15.381519 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:15.382256 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:15.382266 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:15.382693 (+ 427us) client_negotiation.cc:769] Sending connection context
0808 08:52:15.382981 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 08:52:15.383639 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":308,"threads_started":1}
I20260808 08:52:15.386590 8488 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40521
I20260808 08:52:15.386893 8488 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:15.387605 8488 heartbeater.cc:511] Master 127.8.149.126:40521 requested a full tablet report, sending...
I20260808 08:52:15.389786 8170 ts_manager.cc:194] Registered new tserver with Master: ad41da19be6a493e9c3ce5d8d7ed33d8 (127.8.149.65:40157)
I20260808 08:52:15.391180 8170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.65@KRBTEST.COM'} at 127.8.149.65:43981
WARNING: no policy specified for kudu/127.8.149.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
Entry for principal kudu/127.8.149.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab.
I20260808 08:52:15.439296 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:15.774907 8496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:15.775161 8496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:15.775254 8496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:15.782389 8496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:15.782493 8496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:15.782604 8496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:15.792307 8496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.66.keytab
--principal=kudu/127.8.149.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:15.793424 8496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:15.794726 8496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:15.807530 8508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:15.807569 8504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:15.807488 8505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:15.808856 8496 server_base.cc:1034] running on GCE node
I20260808 08:52:15.809494 8496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:15.810343 8496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:15.811575 8496 hybrid_clock.cc:648] HybridClock initialized: now 1786179135811543 us; error 62 us; skew 500 ppm
I20260808 08:52:15.811882 8496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:15 dist-test-slave-7vjv krb5kdc[8095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:15.815238 8496 init.cc:377] Logged in from keytab as kudu/127.8.149.66@KRBTEST.COM (short username kudu)
I20260808 08:52:15.816751 8496 webserver.cc:460] Webserver started at http://127.8.149.66:37935/ using document root <none> and password file <none>
I20260808 08:52:15.817425 8496 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:15.817572 8496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:15.817878 8496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:15.820761 8496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "c575bc8c826949f5a05b0038a4562953"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "20384668d15db028fd334f2b312bd726"
server_key_iv: "9b63073d682c3b9af26f528d34aaaa56"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.821583 8496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "c575bc8c826949f5a05b0038a4562953"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "20384668d15db028fd334f2b312bd726"
server_key_iv: "9b63073d682c3b9af26f528d34aaaa56"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.826534 8496 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:52:15.830056 8525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.831334 8496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:52:15.831530 8496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "c575bc8c826949f5a05b0038a4562953"
format_stamp: "Formatted at 2026-08-08 08:52:15 on dist-test-slave-7vjv"
server_key: "20384668d15db028fd334f2b312bd726"
server_key_iv: "9b63073d682c3b9af26f528d34aaaa56"
server_key_version: "encryptionkey@0"
I20260808 08:52:15.831735 8496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:15.843025 8496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:15.846602 8496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:15.846889 8496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:15.847800 8496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:15.849087 8496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:15.849184 8496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.849336 8496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:15.849413 8496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:15.883008 8496 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:42011
I20260808 08:52:15.883086 8716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:42011 every 8 connection(s)
I20260808 08:52:15.884415 8496 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:15.894335 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 8496
I20260808 08:52:15.894537 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:15.894950 8789 external_mini_cluster.cc:1428] Setting key 0a126c42fb779a02d71965011b01fd0c
Aug 08 08:52:15 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179135, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.66@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:15.905474 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:15.887150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:53555 (local address 127.8.149.126:40521)
0808 08:52:15.887565 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:15.887570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:15.888618 (+ 1048us) server_negotiation.cc:407] Connection header received
0808 08:52:15.890464 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:15.890469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:15.890548 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:15.890671 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:15.892070 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.892790 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.894281 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.894799 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.894922 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:15.899484 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:15.899488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:15.899491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:15.899520 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:15.902277 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:15.903194 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:15.903214 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:15.903219 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:15.903359 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:15.903855 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:15.903858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:15.903860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:15.904151 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:15.904258 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:15.905048 (+ 790us) server_negotiation.cc:299] Negotiation successful
0808 08:52:15.905224 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":216,"threads_started":1}
I20260808 08:52:15.906807 8724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:15.887700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40521 (local address 127.8.149.66:53555)
0808 08:52:15.888464 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:15.888512 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:15.890203 (+ 1691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:15.890899 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:15.890906 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:15.891398 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:15.891912 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:15.891928 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.892947 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.892951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:15.894144 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:15.894156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:15.895028 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:15.895036 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:15.895242 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:15.896190 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:15.896217 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:15.899264 (+ 3047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:15.902413 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:15.902424 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:15.902438 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:15.903075 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:15.903482 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:15.903489 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:15.903496 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:15.903750 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:15.904269 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:15.904279 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:15.904685 (+ 406us) client_negotiation.cc:769] Sending connection context
0808 08:52:15.904980 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 08:52:15.905522 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":343,"threads_started":1}
I20260808 08:52:15.908156 8718 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40521
I20260808 08:52:15.908442 8718 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:15.909076 8718 heartbeater.cc:511] Master 127.8.149.126:40521 requested a full tablet report, sending...
I20260808 08:52:15.910405 8170 ts_manager.cc:194] Registered new tserver with Master: c575bc8c826949f5a05b0038a4562953 (127.8.149.66:42011)
I20260808 08:52:15.911152 8170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.66@KRBTEST.COM'} at 127.8.149.66:53555
WARNING: no policy specified for kudu/127.8.149.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
Entry for principal kudu/127.8.149.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab.
I20260808 08:52:15.959722 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:16.281136 8728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:16.281417 8728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:16.281581 8728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:16.288738 8728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:16.288870 8728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:16.289047 8728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:16.298213 8728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.67.keytab
--principal=kudu/127.8.149.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40521
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:16.299356 8728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:16.300602 8728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:16.313249 8734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:16.313316 8735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:16.313339 8737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:16.314303 8728 server_base.cc:1034] running on GCE node
I20260808 08:52:16.314823 8728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:16.315662 8728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:16.316977 8728 hybrid_clock.cc:648] HybridClock initialized: now 1786179136316903 us; error 54 us; skew 500 ppm
I20260808 08:52:16.317272 8728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:16 dist-test-slave-7vjv krb5kdc[8095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179136, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:16.320355 8728 init.cc:377] Logged in from keytab as kudu/127.8.149.67@KRBTEST.COM (short username kudu)
I20260808 08:52:16.321713 8728 webserver.cc:460] Webserver started at http://127.8.149.67:33515/ using document root <none> and password file <none>
I20260808 08:52:16.322371 8728 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:16.322521 8728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:16.322825 8728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:16.325578 8728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "4bf81fdc96884d7f99addaa4622e2d99"
format_stamp: "Formatted at 2026-08-08 08:52:16 on dist-test-slave-7vjv"
server_key: "642878a410cc9b0ebfa8d99b736661f4"
server_key_iv: "c07e8c573d3b7d6b657c1c07561d44a8"
server_key_version: "encryptionkey@0"
I20260808 08:52:16.326380 8728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "4bf81fdc96884d7f99addaa4622e2d99"
format_stamp: "Formatted at 2026-08-08 08:52:16 on dist-test-slave-7vjv"
server_key: "642878a410cc9b0ebfa8d99b736661f4"
server_key_iv: "c07e8c573d3b7d6b657c1c07561d44a8"
server_key_version: "encryptionkey@0"
I20260808 08:52:16.331636 8728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:52:16.335143 8749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:16.336874 8728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:16.337050 8728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "4bf81fdc96884d7f99addaa4622e2d99"
format_stamp: "Formatted at 2026-08-08 08:52:16 on dist-test-slave-7vjv"
server_key: "642878a410cc9b0ebfa8d99b736661f4"
server_key_iv: "c07e8c573d3b7d6b657c1c07561d44a8"
server_key_version: "encryptionkey@0"
I20260808 08:52:16.337273 8728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:16.363080 8728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:16.367424 8728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:16.367712 8728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:16.368750 8728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:16.369992 8728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:16.370065 8728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:16.370241 8728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:16.370292 8728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:16.394692 8488 heartbeater.cc:503] Master 127.8.149.126:40521 was elected leader, sending a full tablet report...
I20260808 08:52:16.402087 8728 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:44049
I20260808 08:52:16.402184 8967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:44049 every 8 connection(s)
I20260808 08:52:16.403301 8728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:16.404898 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 8728
I20260808 08:52:16.405071 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:16.405593 8789 external_mini_cluster.cc:1428] Setting key 4e02528e3ae6b1249582f3b1594c4bde
Aug 08 08:52:16 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179136, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.67@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:16.423452 8971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.406238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:50675 (local address 127.8.149.126:40521)
0808 08:52:16.406719 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.406725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.407661 (+ 936us) server_negotiation.cc:407] Connection header received
0808 08:52:16.409948 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.409951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.410009 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.410095 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:16.411398 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.412212 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.413551 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.413975 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.414072 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.417483 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:16.417487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:16.417490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:16.417520 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:16.420497 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.421210 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.421215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.421218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.421339 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.421765 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.421770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.421773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.422049 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:16.422205 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.422834 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.423054 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":259,"threads_started":1}
I20260808 08:52:16.424324 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.406705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40521 (local address 127.8.149.67:50675)
0808 08:52:16.407499 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.407561 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.409702 (+ 2141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.410275 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.410282 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.410774 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:16.411257 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.411273 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.412330 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.412334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.413435 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.413446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.414172 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.414177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.414352 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.415048 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:52:16.415071 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:16.417280 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:16.420621 (+ 3341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:16.420629 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:16.420659 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:16.421061 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:16.421450 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:52:16.421454 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:52:16.421458 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:52:16.421634 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:52:16.422187 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:16.422195 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:16.422485 (+ 290us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.422739 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.423240 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":314,"threads_started":1}
I20260808 08:52:16.425545 8968 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40521
I20260808 08:52:16.425815 8968 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:16.426518 8968 heartbeater.cc:511] Master 127.8.149.126:40521 requested a full tablet report, sending...
I20260808 08:52:16.427875 8170 ts_manager.cc:194] Registered new tserver with Master: 4bf81fdc96884d7f99addaa4622e2d99 (127.8.149.67:44049)
I20260808 08:52:16.428649 8170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.8.149.67@KRBTEST.COM'} at 127.8.149.67:50675
I20260808 08:52:16.432998 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:16.448503 8971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.436943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47400 (local address 127.8.149.126:40521)
0808 08:52:16.437099 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.437102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.437546 (+ 444us) server_negotiation.cc:407] Connection header received
0808 08:52:16.437669 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.437673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.437726 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.437803 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:16.439143 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.439784 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.440992 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.441327 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.441473 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.443734 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:16.443740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:16.443744 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:16.443783 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:16.446027 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.446591 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.446597 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.446600 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.446738 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.447097 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.447104 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.447107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.447387 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:16.447650 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.447977 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.448197 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 08:52:16.451733 8170 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:16.458225 8170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:16.492902 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.470747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.8.149.67:44049)
0808 08:52:16.484368 (+ 13621us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.484378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.484505 (+ 127us) server_negotiation.cc:407] Connection header received
0808 08:52:16.484619 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.484628 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.484840 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.485036 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:16.486174 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.487737 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.490431 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491417 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.491538 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.491759 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.492391 (+ 632us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.492557 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13455,"thread_start_us":13274,"threads_started":1}
I20260808 08:52:16.492946 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.469222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:42011 (local address 127.0.0.1:37316)
0808 08:52:16.481749 (+ 12527us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.481795 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.482005 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.484232 (+ 2227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.484239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.484283 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:16.484924 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.484966 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.487202 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.487208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.489920 (+ 2712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.489946 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491990 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.491996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.492277 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.492298 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.492374 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.492563 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12207,"mutex_wait_us":176,"thread_start_us":12996,"threads_started":1}
I20260808 08:52:16.492993 8995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.469463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.8.149.66:42011)
0808 08:52:16.483293 (+ 13830us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.483304 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.483335 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:52:16.483454 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.483461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.483722 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.483906 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:16.485168 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.487050 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.490100 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491513 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.491641 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.491809 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.492521 (+ 712us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.492673 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13662,"thread_start_us":13553,"threads_started":1}
I20260808 08:52:16.493083 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.471251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.8.149.65:40157)
0808 08:52:16.484147 (+ 12896us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.484199 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.485148 (+ 949us) server_negotiation.cc:407] Connection header received
0808 08:52:16.485247 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.485254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.485455 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.485640 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:16.486475 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.487853 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.490155 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491513 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.491640 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.491841 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.492654 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.492803 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12682,"thread_start_us":12505,"threads_started":1}
I20260808 08:52:16.493794 8998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.469895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:40157 (local address 127.0.0.1:51890)
0808 08:52:16.484780 (+ 14885us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.484806 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.484984 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.485661 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.485665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.485694 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:16.486208 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.486236 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.488032 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.488039 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.489956 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.489968 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491997 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.492002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.492265 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.492298 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.492381 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.492558 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14763,"mutex_wait_us":147,"thread_start_us":14639,"threads_started":1}
I20260808 08:52:16.493836 8996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.469534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:44049 (local address 127.0.0.1:36998)
0808 08:52:16.483589 (+ 14055us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.483606 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.483727 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.485352 (+ 1625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.485356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.485380 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:16.485919 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.485937 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.487962 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.487969 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.490280 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.490289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.491909 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.491915 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.492190 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.492225 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.492351 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.493339 (+ 988us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13945,"mutex_wait_us":843,"thread_start_us":13814,"threads_started":1}
I20260808 08:52:16.496708 8590 tablet_service.cc:1467] Processing CreateTablet for tablet 6240a252069649f1a25d64153fc6ae90 (DEFAULT_TABLE table=test-table [id=6c058914f87144af9318399f2ad0f6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:16.496771 8841 tablet_service.cc:1467] Processing CreateTablet for tablet 6240a252069649f1a25d64153fc6ae90 (DEFAULT_TABLE table=test-table [id=6c058914f87144af9318399f2ad0f6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:16.497929 8841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6240a252069649f1a25d64153fc6ae90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:16.497926 8590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6240a252069649f1a25d64153fc6ae90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:16.502713 8380 tablet_service.cc:1467] Processing CreateTablet for tablet 6240a252069649f1a25d64153fc6ae90 (DEFAULT_TABLE table=test-table [id=6c058914f87144af9318399f2ad0f6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:16.503966 8380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6240a252069649f1a25d64153fc6ae90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:16.509809 9004 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Bootstrap starting.
I20260808 08:52:16.512830 9005 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Bootstrap starting.
I20260808 08:52:16.514004 9004 tablet_bootstrap.cc:654] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:16.515355 9004 log.cc:824] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:16.516343 9005 tablet_bootstrap.cc:654] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:16.517511 9005 log.cc:824] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:16.518030 9004 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: No bootstrap required, opened a new log
I20260808 08:52:16.518352 9004 ts_tablet_manager.cc:1397] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260808 08:52:16.518608 9009 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Bootstrap starting.
I20260808 08:52:16.522240 9009 tablet_bootstrap.cc:654] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:16.522554 9005 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: No bootstrap required, opened a new log
I20260808 08:52:16.522856 9005 ts_tablet_manager.cc:1397] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 08:52:16.523583 9009 log.cc:824] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:16.526355 9009 tablet_bootstrap.cc:492] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: No bootstrap required, opened a new log
I20260808 08:52:16.526612 9009 ts_tablet_manager.cc:1397] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260808 08:52:16.528389 9004 raft_consensus.cc:348] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.528820 9004 raft_consensus.cc:374] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:16.528913 9004 raft_consensus.cc:729] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c575bc8c826949f5a05b0038a4562953, State: Initialized, Role: FOLLOWER
I20260808 08:52:16.529505 9004 consensus_queue.cc:260] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.530586 8718 heartbeater.cc:503] Master 127.8.149.126:40521 was elected leader, sending a full tablet report...
I20260808 08:52:16.531250 9004 ts_tablet_manager.cc:1428] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 08:52:16.531903 9005 raft_consensus.cc:348] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.532356 9005 raft_consensus.cc:374] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:16.532459 9005 raft_consensus.cc:729] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf81fdc96884d7f99addaa4622e2d99, State: Initialized, Role: FOLLOWER
I20260808 08:52:16.533041 9005 consensus_queue.cc:260] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.534772 9005 ts_tablet_manager.cc:1428] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Time spent starting tablet: real 0.012s user 0.005s sys 0.005s
I20260808 08:52:16.534825 8968 heartbeater.cc:503] Master 127.8.149.126:40521 was elected leader, sending a full tablet report...
I20260808 08:52:16.536703 9009 raft_consensus.cc:348] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.537160 9009 raft_consensus.cc:374] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:16.537271 9009 raft_consensus.cc:729] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad41da19be6a493e9c3ce5d8d7ed33d8, State: Initialized, Role: FOLLOWER
I20260808 08:52:16.537894 9009 consensus_queue.cc:260] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.539407 9009 ts_tablet_manager.cc:1428] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Time spent starting tablet: real 0.013s user 0.008s sys 0.006s
I20260808 08:52:16.543524 9016 raft_consensus.cc:482] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:16.543741 9016 raft_consensus.cc:504] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.545311 9016 leader_election.cc:288] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c575bc8c826949f5a05b0038a4562953 (127.8.149.66:42011), ad41da19be6a493e9c3ce5d8d7ed33d8 (127.8.149.65:40157)
I20260808 08:52:16.551590 8995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.545689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:44047 (local address 127.8.149.66:42011)
0808 08:52:16.545961 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.545968 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.546002 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:52:16.546256 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.546264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.546345 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.546454 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:16.546864 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.547620 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.549751 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.550603 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.550778 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.550859 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.551172 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.551302 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260808 08:52:16.551610 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.545615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:42011 (local address 127.8.149.67:44047)
0808 08:52:16.545882 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.545910 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.546057 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.546502 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.546507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.546542 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:16.546710 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.546718 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.547767 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.547776 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.549445 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.549459 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.550767 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.550773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.550999 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.551027 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.551146 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.551294 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:52:16.552223 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.545872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:43643 (local address 127.8.149.65:40157)
0808 08:52:16.546071 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.546078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.546662 (+ 584us) server_negotiation.cc:407] Connection header received
0808 08:52:16.546840 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.546849 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.546900 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.546991 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:16.547713 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.548730 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.550459 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.551225 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.551403 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.551483 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.551809 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.551943 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:52:16.552819 9020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.545673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:40157 (local address 127.8.149.67:43643)
0808 08:52:16.546551 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:16.546568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:16.546704 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:16.547020 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:16.547025 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:16.547050 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:16.547368 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.547376 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.548879 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.548884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.550306 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:16.550318 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.551424 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.551431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:16.551593 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.551619 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:52:16.552412 (+ 793us) client_negotiation.cc:240] Negotiation successful
0808 08:52:16.552549 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"mutex_wait_us":86,"thread_start_us":441,"threads_started":1}
I20260808 08:52:16.552656 8623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6240a252069649f1a25d64153fc6ae90" candidate_uuid: "4bf81fdc96884d7f99addaa4622e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c575bc8c826949f5a05b0038a4562953" is_pre_election: true
I20260808 08:52:16.553157 8623 raft_consensus.cc:2454] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bf81fdc96884d7f99addaa4622e2d99 in term 0.
I20260808 08:52:16.553867 8750 leader_election.cc:302] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bf81fdc96884d7f99addaa4622e2d99, c575bc8c826949f5a05b0038a4562953; no voters:
I20260808 08:52:16.554302 9016 raft_consensus.cc:2781] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:16.554484 9016 raft_consensus.cc:482] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:16.554605 9016 raft_consensus.cc:3037] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:16.554486 8407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6240a252069649f1a25d64153fc6ae90" candidate_uuid: "4bf81fdc96884d7f99addaa4622e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" is_pre_election: true
I20260808 08:52:16.555022 8407 raft_consensus.cc:2454] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bf81fdc96884d7f99addaa4622e2d99 in term 0.
I20260808 08:52:16.557319 9016 raft_consensus.cc:504] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.557883 9016 leader_election.cc:288] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [CANDIDATE]: Term 1 election: Requested vote from peers c575bc8c826949f5a05b0038a4562953 (127.8.149.66:42011), ad41da19be6a493e9c3ce5d8d7ed33d8 (127.8.149.65:40157)
I20260808 08:52:16.558238 8623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6240a252069649f1a25d64153fc6ae90" candidate_uuid: "4bf81fdc96884d7f99addaa4622e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c575bc8c826949f5a05b0038a4562953"
I20260808 08:52:16.558321 8407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6240a252069649f1a25d64153fc6ae90" candidate_uuid: "4bf81fdc96884d7f99addaa4622e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8"
I20260808 08:52:16.558435 8623 raft_consensus.cc:3037] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:16.558576 8407 raft_consensus.cc:3037] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:16.560752 8623 raft_consensus.cc:2454] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bf81fdc96884d7f99addaa4622e2d99 in term 1.
I20260808 08:52:16.560866 8407 raft_consensus.cc:2454] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bf81fdc96884d7f99addaa4622e2d99 in term 1.
I20260808 08:52:16.561168 8750 leader_election.cc:302] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bf81fdc96884d7f99addaa4622e2d99, c575bc8c826949f5a05b0038a4562953; no voters:
I20260808 08:52:16.561430 9016 raft_consensus.cc:2781] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:16.561896 9016 raft_consensus.cc:686] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 1 LEADER]: Becoming Leader. State: Replica: 4bf81fdc96884d7f99addaa4622e2d99, State: Running, Role: LEADER
I20260808 08:52:16.562327 9016 consensus_queue.cc:237] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } }
I20260808 08:52:16.566751 8170 catalog_manager.cc:5495] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bf81fdc96884d7f99addaa4622e2d99 (127.8.149.67). New cstate: current_term: 1 leader_uuid: "4bf81fdc96884d7f99addaa4622e2d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bf81fdc96884d7f99addaa4622e2d99" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 44049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:16.593978 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.589350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37008 (local address 127.8.149.67:44049)
0808 08:52:16.589527 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.589530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.589560 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:52:16.589697 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.589700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.589792 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.589949 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:16.590252 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.590944 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.592248 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.592614 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.592705 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.593134 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:16.593561 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:16.593660 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.593739 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.593794 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:52:16.601486 8623 raft_consensus.cc:1261] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 1 FOLLOWER]: Refusing update from remote peer 4bf81fdc96884d7f99addaa4622e2d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:16.601472 8407 raft_consensus.cc:1261] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 1 FOLLOWER]: Refusing update from remote peer 4bf81fdc96884d7f99addaa4622e2d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:16.602393 9023 consensus_queue.cc:1035] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad41da19be6a493e9c3ce5d8d7ed33d8" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 40157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:16.602754 9016 consensus_queue.cc:1035] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c575bc8c826949f5a05b0038a4562953" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 42011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:16.613274 9029 mvcc.cc:205] Tried to move back new op lower bound from 7316189743510282240 to 7316189743363469312. Current Snapshot: MvccSnapshot[applied={T|T < 7316189743510282240}]
W20260808 08:52:16.613931 8489 tablet.cc:2369] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:52:16.627723 8170 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:16.627929 8170 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:16.631421 8170 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f219dbcd72ac4174a8ced460fd3b75d1: Sending DeleteTablet for 3 replicas of tablet 6240a252069649f1a25d64153fc6ae90
I20260808 08:52:16.632587 8590 tablet_service.cc:1514] Processing DeleteTablet for tablet 6240a252069649f1a25d64153fc6ae90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:37316
I20260808 08:52:16.632639 8841 tablet_service.cc:1514] Processing DeleteTablet for tablet 6240a252069649f1a25d64153fc6ae90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:36998
I20260808 08:52:16.633226 8380 tablet_service.cc:1514] Processing DeleteTablet for tablet 6240a252069649f1a25d64153fc6ae90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:16 UTC) from {username='kudu', principal='kudu/127.8.149.126@KRBTEST.COM'} at 127.0.0.1:51890
I20260808 08:52:16.633716 9045 tablet_replica.cc:330] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: stopping tablet replica
I20260808 08:52:16.634197 9045 raft_consensus.cc:2229] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:16.634251 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 8281
I20260808 08:52:16.634713 9045 raft_consensus.cc:2258] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:16.637658 9045 ts_tablet_manager.cc:1905] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:16.647965 9051 tablet_replica.cc:330] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: stopping tablet replica
I20260808 08:52:16.648483 9051 raft_consensus.cc:2229] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:16.648993 9051 raft_consensus.cc:2258] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:16.651645 9051 ts_tablet_manager.cc:1905] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:16.653784 9045 ts_tablet_manager.cc:1918] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:16.654136 9045 log.cc:1196] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/6240a252069649f1a25d64153fc6ae90
I20260808 08:52:16.654911 9045 ts_tablet_manager.cc:1939] T 6240a252069649f1a25d64153fc6ae90 P c575bc8c826949f5a05b0038a4562953: Deleting consensus metadata
I20260808 08:52:16.657370 8140 catalog_manager.cc:4841] TS c575bc8c826949f5a05b0038a4562953 (127.8.149.66:42011): tablet 6240a252069649f1a25d64153fc6ae90 (table test-table [id=6c058914f87144af9318399f2ad0f6e4]) successfully deleted
I20260808 08:52:16.657512 9048 tablet_replica.cc:330] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: stopping tablet replica
I20260808 08:52:16.657918 9048 raft_consensus.cc:2229] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:16.658617 9048 raft_consensus.cc:2258] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:16.661059 9048 ts_tablet_manager.cc:1905] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:52:16 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.65@KRBTEST.COM
I20260808 08:52:16.663697 9051 ts_tablet_manager.cc:1918] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:16.663930 9051 log.cc:1196] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-0/wal/wals/6240a252069649f1a25d64153fc6ae90
I20260808 08:52:16.664669 9051 ts_tablet_manager.cc:1939] T 6240a252069649f1a25d64153fc6ae90 P ad41da19be6a493e9c3ce5d8d7ed33d8: Deleting consensus metadata
I20260808 08:52:16.666427 8143 catalog_manager.cc:4841] TS ad41da19be6a493e9c3ce5d8d7ed33d8 (127.8.149.65:40157): tablet 6240a252069649f1a25d64153fc6ae90 (table test-table [id=6c058914f87144af9318399f2ad0f6e4]) successfully deleted
I20260808 08:52:16.669253 9048 ts_tablet_manager.cc:1918] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:16.669449 9048 log.cc:1196] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/6240a252069649f1a25d64153fc6ae90
I20260808 08:52:16.670049 9048 ts_tablet_manager.cc:1939] T 6240a252069649f1a25d64153fc6ae90 P 4bf81fdc96884d7f99addaa4622e2d99: Deleting consensus metadata
I20260808 08:52:16.671691 8144 catalog_manager.cc:4841] TS 4bf81fdc96884d7f99addaa4622e2d99 (127.8.149.67:44049): tablet 6240a252069649f1a25d64153fc6ae90 (table test-table [id=6c058914f87144af9318399f2ad0f6e4]) successfully deleted
I20260808 08:52:16.672026 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.635314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.8.149.65:40157)
0808 08:52:16.635516 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.635525 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.647396 (+ 11871us) server_negotiation.cc:407] Connection header received
0808 08:52:16.647865 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.647870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.647947 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.648037 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:16.651874 (+ 3837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.652954 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.656229 (+ 3275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.656845 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.656936 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.664021 (+ 7085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:16.664036 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:16.664065 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:16.664134 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:16.668222 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.669150 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.669159 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.669162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.669325 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.669931 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.669940 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.669945 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.670448 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:16.670733 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.671392 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.671617 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:52:16.673362 8480 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:16.762436 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 8281
I20260808 08:52:16.799530 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 8496
Aug 08 08:52:16 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.66@KRBTEST.COM
I20260808 08:52:16.816082 8995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.800490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37328 (local address 127.8.149.66:42011)
0808 08:52:16.800715 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.800721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.800741 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:52:16.800916 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.800922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.801010 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.801118 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:16.802477 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.803275 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.804594 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.804981 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.805135 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.809731 (+ 4596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:16.809747 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:16.809763 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:16.809802 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:16.812925 (+ 3123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.813738 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.813746 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.813748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.813915 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.814342 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.814349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.814365 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.814772 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:16.815111 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.815469 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.815689 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:52:16.816802 8710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:16.930310 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 8496
I20260808 08:52:16.957067 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 8728
Aug 08 08:52:16 dist-test-slave-7vjv krb5kdc[8095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.67@KRBTEST.COM
I20260808 08:52:16.973181 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:16.957912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37014 (local address 127.8.149.67:44049)
0808 08:52:16.958109 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:16.958116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:16.958141 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:52:16.958365 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:16.958371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:16.958449 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:16.958571 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:16.959905 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.960955 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.962209 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:16.962678 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:16.962821 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:16.967280 (+ 4459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:16.967289 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:16.967305 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:16.967338 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:16.970256 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.970981 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.970992 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.970994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.971132 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:16.971553 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:16.971559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:16.971569 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:16.971931 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:16.972279 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:16.972580 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 08:52:16.972818 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:52:16.973948 8959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:17.093173 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 8728
I20260808 08:52:17.121241 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 8117
I20260808 08:52:17.122391 8225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:17.228710 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 8117
2026-08-08T08:52:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4501 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T08:52:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:17Z Disabled control of system clock
I20260808 08:52:17.321837 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40077
--webserver_interface=127.8.149.126
--webserver_port=0
--builtin_ntp_servers=127.8.149.84:40581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:17.659963 9066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:17.660225 9066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:17.660300 9066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:17.667409 9066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:17.667503 9066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:17.667542 9066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:17.667600 9066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:17.667642 9066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:17.676189 9066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40077
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:17.677352 9066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:17.679009 9066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:17.690678 9084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:17.690766 9075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:17.690996 9074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:17.691815 9066 server_base.cc:1034] running on GCE node
I20260808 08:52:17.692672 9066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:17.693936 9066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:17.695243 9066 hybrid_clock.cc:648] HybridClock initialized: now 1786179137695163 us; error 60 us; skew 500 ppm
I20260808 08:52:17.695652 9066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:17.701502 9066 webserver.cc:460] Webserver started at http://127.8.149.126:37579/ using document root <none> and password file <none>
I20260808 08:52:17.702255 9066 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:17.702407 9066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:17.702757 9066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:17.705765 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "5b14b962f7b24622b7d2016d86e068cf"
format_stamp: "Formatted at 2026-08-08 08:52:17 on dist-test-slave-7vjv"
server_key: "63e5109e26cf4c025de17c3e2f620367"
server_key_iv: "0b68b65867b1e935b38fc532389bc7b6"
server_key_version: "encryptionkey@0"
I20260808 08:52:17.706614 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "5b14b962f7b24622b7d2016d86e068cf"
format_stamp: "Formatted at 2026-08-08 08:52:17 on dist-test-slave-7vjv"
server_key: "63e5109e26cf4c025de17c3e2f620367"
server_key_iv: "0b68b65867b1e935b38fc532389bc7b6"
server_key_version: "encryptionkey@0"
I20260808 08:52:17.711894 9066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:52:17.715417 9094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:17.716758 9066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:52:17.716964 9066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "5b14b962f7b24622b7d2016d86e068cf"
format_stamp: "Formatted at 2026-08-08 08:52:17 on dist-test-slave-7vjv"
server_key: "63e5109e26cf4c025de17c3e2f620367"
server_key_iv: "0b68b65867b1e935b38fc532389bc7b6"
server_key_version: "encryptionkey@0"
I20260808 08:52:17.717199 9066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:17.738020 9066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:17.738785 9066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:17.739104 9066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:17.760011 9066 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40077
I20260808 08:52:17.760028 9179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40077 every 8 connection(s)
I20260808 08:52:17.761364 9066 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:17.764796 9180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:17.765800 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9066
I20260808 08:52:17.765981 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:17.766546 8789 external_mini_cluster.cc:1428] Setting key 49cf3ab40ce5662877cb56140548294d
I20260808 08:52:17.778199 9180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: Bootstrap starting.
I20260808 08:52:17.780310 9185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:17.768497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56812 (local address 127.8.149.126:40077)
0808 08:52:17.769586 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:17.769600 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:17.769647 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:52:17.771284 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:17.771309 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:17.771769 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:17.772138 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:17.772686 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:17.774010 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:17.775812 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:17.776506 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:17.776636 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:17.777922 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:17.777929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:17.777941 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:17.778521 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:17.778599 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:17.778622 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:17.778716 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:17.778977 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:52:17.779299 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":496,"threads_started":1}
I20260808 08:52:17.781646 9180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:17.782656 9180 log.cc:824] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:17.785213 9180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: No bootstrap required, opened a new log
I20260808 08:52:17.791952 9180 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } }
I20260808 08:52:17.792440 9180 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:17.792562 9180 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b14b962f7b24622b7d2016d86e068cf, State: Initialized, Role: FOLLOWER
I20260808 08:52:17.793151 9180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } }
I20260808 08:52:17.793393 9180 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:17.793541 9180 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:17.793728 9180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:17.795758 9180 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } }
I20260808 08:52:17.796277 9180 leader_election.cc:302] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b14b962f7b24622b7d2016d86e068cf; no voters:
I20260808 08:52:17.796824 9180 leader_election.cc:288] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:17.797022 9189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:17.797945 9189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [term 1 LEADER]: Becoming Leader. State: Replica: 5b14b962f7b24622b7d2016d86e068cf, State: Running, Role: LEADER
I20260808 08:52:17.798564 9189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } }
I20260808 08:52:17.798882 9180 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:17.802742 9191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b14b962f7b24622b7d2016d86e068cf. Latest consensus state: current_term: 1 leader_uuid: "5b14b962f7b24622b7d2016d86e068cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } } }
I20260808 08:52:17.802838 9190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b14b962f7b24622b7d2016d86e068cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b14b962f7b24622b7d2016d86e068cf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40077 } } }
I20260808 08:52:17.803354 9191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:17.803359 9190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:17.805380 9201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:17.810483 9201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:17.819429 9201 catalog_manager.cc:1347] Generated new cluster ID: a9c57f4cec7a4f91a75060b27a8cad5d
I20260808 08:52:17.819550 9201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:17.846933 9201 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:17.848405 9201 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:17.855136 9201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: Generated new TSK 0
I20260808 08:52:17.855849 9201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:17.864228 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.65:0
--local_ip_for_outbound_sockets=127.8.149.65
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--builtin_ntp_servers=127.8.149.84:40581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:52:18.221396 9220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:18.221644 9220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:18.221735 9220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:18.228304 9220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:18.228386 9220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:18.228479 9220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.65
I20260808 08:52:18.236830 9220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.149.65
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.65
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:18.237929 9220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:18.239638 9220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:18.252311 9230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:18.252357 9232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:18.252400 9229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:18.258922 9220 server_base.cc:1034] running on GCE node
I20260808 08:52:18.259459 9220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:18.260396 9220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:18.261623 9220 hybrid_clock.cc:648] HybridClock initialized: now 1786179138261590 us; error 43 us; skew 500 ppm
I20260808 08:52:18.261931 9220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:18.264129 9220 webserver.cc:460] Webserver started at http://127.8.149.65:43733/ using document root <none> and password file <none>
I20260808 08:52:18.264786 9220 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:18.264914 9220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:18.265241 9220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:18.267946 9220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data/instance:
uuid: "f2738e1a2a7a47d2a614837fd4473bde"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "a4425791accd30b4eeda5e84c00be488"
server_key_iv: "a764a92a7e731372455601c845eaeae0"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.268939 9220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance:
uuid: "f2738e1a2a7a47d2a614837fd4473bde"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "a4425791accd30b4eeda5e84c00be488"
server_key_iv: "a764a92a7e731372455601c845eaeae0"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.273712 9220 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:52:18.277230 9239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.278481 9220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:18.278645 9220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal
uuid: "f2738e1a2a7a47d2a614837fd4473bde"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "a4425791accd30b4eeda5e84c00be488"
server_key_iv: "a764a92a7e731372455601c845eaeae0"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.278853 9220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:18.297298 9220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:18.297952 9220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:18.298230 9220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:18.299216 9220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:18.300768 9220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:18.300884 9220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.301007 9220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:18.301096 9220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.335667 9220 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.65:37089
I20260808 08:52:18.335795 9426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.65:37089 every 8 connection(s)
I20260808 08:52:18.337430 9220 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/data/info.pb
I20260808 08:52:18.340152 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9220
I20260808 08:52:18.340349 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-0/wal/instance
I20260808 08:52:18.340951 8789 external_mini_cluster.cc:1428] Setting key 8e687dbb86e71a9ec4f074aeea21cea2
I20260808 08:52:18.344321 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.66:0
--local_ip_for_outbound_sockets=127.8.149.66
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--builtin_ntp_servers=127.8.149.84:40581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:18.364001 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:18.340829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:58561 (local address 127.8.149.126:40077)
0808 08:52:18.356379 (+ 15550us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:18.356387 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:18.356417 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:52:18.356479 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:18.356486 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:18.356567 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:18.356679 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:18.357814 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.358532 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.361059 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.361463 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.361570 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:18.363253 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:18.363257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:18.363260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:18.363278 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:18.363317 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:18.363329 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:18.363400 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:18.363661 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:52:18.363737 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15418,"thread_start_us":15308,"threads_started":1}
I20260808 08:52:18.365458 9435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:18.341634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40077 (local address 127.8.149.65:58561)
0808 08:52:18.352956 (+ 11322us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:18.353013 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:18.355709 (+ 2696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:18.356877 (+ 1168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:18.356885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:18.357014 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:18.357632 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:18.357649 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.358690 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.358695 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:18.360903 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:18.360922 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.361723 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.361735 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:18.362140 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:18.362864 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:18.362870 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:18.362940 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:18.363042 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:18.363438 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:18.363452 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:18.363463 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:52:18.363641 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 08:52:18.364054 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10788,"thread_start_us":10530,"threads_started":1}
I20260808 08:52:18.367046 9427 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40077
I20260808 08:52:18.367339 9427 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:18.368251 9427 heartbeater.cc:511] Master 127.8.149.126:40077 requested a full tablet report, sending...
I20260808 08:52:18.370564 9120 ts_manager.cc:194] Registered new tserver with Master: f2738e1a2a7a47d2a614837fd4473bde (127.8.149.65:37089)
I20260808 08:52:18.372846 9120 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.65:58561
W20260808 08:52:18.679194 9438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:18.679440 9438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:18.679515 9438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:18.686856 9438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:18.686946 9438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:18.687041 9438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.66
I20260808 08:52:18.695641 9438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.149.66
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.66
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:18.696732 9438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:18.698246 9438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:18.710992 9447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:18.711071 9446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:18.711140 9450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:18.711958 9438 server_base.cc:1034] running on GCE node
I20260808 08:52:18.712623 9438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:18.713469 9438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:18.714679 9438 hybrid_clock.cc:648] HybridClock initialized: now 1786179138714631 us; error 26 us; skew 500 ppm
I20260808 08:52:18.714999 9438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:18.717060 9438 webserver.cc:460] Webserver started at http://127.8.149.66:34515/ using document root <none> and password file <none>
I20260808 08:52:18.717711 9438 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:18.717823 9438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:18.718147 9438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:18.721042 9438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data/instance:
uuid: "5aa72f3409f846edb2412e56ebe55235"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "08db2ee090e1d84c981c3613590e34f0"
server_key_iv: "0d1770e6c5e4c4553d774b626c46e0eb"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.721876 9438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance:
uuid: "5aa72f3409f846edb2412e56ebe55235"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "08db2ee090e1d84c981c3613590e34f0"
server_key_iv: "0d1770e6c5e4c4553d774b626c46e0eb"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.726464 9438 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:52:18.729703 9463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.730854 9438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:52:18.731014 9438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal
uuid: "5aa72f3409f846edb2412e56ebe55235"
format_stamp: "Formatted at 2026-08-08 08:52:18 on dist-test-slave-7vjv"
server_key: "08db2ee090e1d84c981c3613590e34f0"
server_key_iv: "0d1770e6c5e4c4553d774b626c46e0eb"
server_key_version: "encryptionkey@0"
I20260808 08:52:18.731218 9438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:18.760259 9438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:18.760982 9438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:18.761277 9438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:18.762189 9438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:18.763554 9438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:18.763669 9438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.763793 9438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:18.763885 9438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:18.799847 9438 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.66:44825
I20260808 08:52:18.799919 9637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.66:44825 every 8 connection(s)
I20260808 08:52:18.801002 9438 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/data/info.pb
I20260808 08:52:18.801998 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9438
I20260808 08:52:18.802186 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal/instance
I20260808 08:52:18.802748 8789 external_mini_cluster.cc:1428] Setting key 22f104cabacbf266b2361c3973241eda
I20260808 08:52:18.805831 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.149.67:0
--local_ip_for_outbound_sockets=127.8.149.67
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--builtin_ntp_servers=127.8.149.84:40581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:52:18.813133 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:18.803560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.66:48551 (local address 127.8.149.126:40077)
0808 08:52:18.803752 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:18.803755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:18.805180 (+ 1425us) server_negotiation.cc:407] Connection header received
0808 08:52:18.807036 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:18.807042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:18.807130 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:18.807237 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:18.808295 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.809004 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.810405 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.810809 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.810946 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:18.812363 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:18.812368 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:18.812370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:18.812386 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:18.812414 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:18.812426 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:18.812515 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:18.812733 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 08:52:18.812829 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:52:18.814042 9643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:18.804204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40077 (local address 127.8.149.66:48551)
0808 08:52:18.805035 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:18.805069 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:18.806768 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:18.807457 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:18.807465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:18.807552 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:18.808072 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:18.808149 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.809159 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.809166 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:18.810261 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:18.810273 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:18.811044 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:18.811052 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:18.811293 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:18.811994 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:18.811997 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:18.812034 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:18.812169 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:18.812517 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:18.812531 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:18.812539 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:52:18.812704 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 08:52:18.813034 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":287,"threads_started":1}
I20260808 08:52:18.815412 9640 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40077
I20260808 08:52:18.815719 9640 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:18.816493 9640 heartbeater.cc:511] Master 127.8.149.126:40077 requested a full tablet report, sending...
I20260808 08:52:18.817868 9120 ts_manager.cc:194] Registered new tserver with Master: 5aa72f3409f846edb2412e56ebe55235 (127.8.149.66:44825)
I20260808 08:52:18.818638 9120 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.66:48551
W20260808 08:52:19.127399 9644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:19.127635 9644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:19.127710 9644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:19.134049 9644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:19.134124 9644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:19.134248 9644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.149.67
I20260808 08:52:19.142803 9644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.149.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.149.67
--webserver_port=0
--tserver_master_addrs=127.8.149.126:40077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.149.67
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:19.143815 9644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:19.145476 9644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:19.157701 9651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:19.157688 9652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:19.158145 9657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:19.158639 9644 server_base.cc:1034] running on GCE node
I20260808 08:52:19.159157 9644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:19.159971 9644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:19.161178 9644 hybrid_clock.cc:648] HybridClock initialized: now 1786179139161139 us; error 37 us; skew 500 ppm
I20260808 08:52:19.161450 9644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:52:19.163520 9644 webserver.cc:460] Webserver started at http://127.8.149.67:35947/ using document root <none> and password file <none>
I20260808 08:52:19.164139 9644 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:19.164259 9644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:19.164562 9644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:19.167039 9644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data/instance:
uuid: "298670c794734df1a0da5e2ff0c0df67"
format_stamp: "Formatted at 2026-08-08 08:52:19 on dist-test-slave-7vjv"
server_key: "1266834f295ecf73300206032021460c"
server_key_iv: "256b86a2e14a8ba8e6685f739a741dfd"
server_key_version: "encryptionkey@0"
I20260808 08:52:19.167682 9644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance:
uuid: "298670c794734df1a0da5e2ff0c0df67"
format_stamp: "Formatted at 2026-08-08 08:52:19 on dist-test-slave-7vjv"
server_key: "1266834f295ecf73300206032021460c"
server_key_iv: "256b86a2e14a8ba8e6685f739a741dfd"
server_key_version: "encryptionkey@0"
I20260808 08:52:19.172227 9644 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260808 08:52:19.175420 9664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:19.176677 9644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:19.176847 9644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal
uuid: "298670c794734df1a0da5e2ff0c0df67"
format_stamp: "Formatted at 2026-08-08 08:52:19 on dist-test-slave-7vjv"
server_key: "1266834f295ecf73300206032021460c"
server_key_iv: "256b86a2e14a8ba8e6685f739a741dfd"
server_key_version: "encryptionkey@0"
I20260808 08:52:19.177058 9644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:19.204403 9644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:19.205161 9644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:19.205456 9644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:19.206399 9644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:52:19.207799 9644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:52:19.207932 9644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:19.208057 9644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:52:19.208168 9644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 08:52:19.241590 9644 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.67:33375
I20260808 08:52:19.241668 9847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.67:33375 every 8 connection(s)
I20260808 08:52:19.242827 9644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/data/info.pb
I20260808 08:52:19.247009 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9644
I20260808 08:52:19.247188 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal/instance
I20260808 08:52:19.247754 8789 external_mini_cluster.cc:1428] Setting key 384ca9650374e5591a282c290a0b6c26
I20260808 08:52:19.254623 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.245371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.67:42693 (local address 127.8.149.126:40077)
0808 08:52:19.245566 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.245570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.246874 (+ 1304us) server_negotiation.cc:407] Connection header received
0808 08:52:19.249148 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.249155 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.249224 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.249296 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:19.250359 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.251099 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.252495 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.252852 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.252947 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.254021 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:19.254025 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:19.254027 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:19.254042 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:19.254069 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:19.254078 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:19.254139 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.254325 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.254401 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:52:19.255475 9851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.245818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40077 (local address 127.8.149.67:42693)
0808 08:52:19.246731 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.246778 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.248859 (+ 2081us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.249527 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.249552 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.249649 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:52:19.250183 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.250198 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.251226 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.251230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.252384 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.252395 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.253021 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.253026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.253208 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.253770 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:52:19.253773 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:52:19.253804 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:52:19.253865 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:52:19.254151 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:52:19.254158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:52:19.254162 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.254299 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.254552 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":278,"threads_started":1}
I20260808 08:52:19.256785 9849 heartbeater.cc:347] Connected to a master server at 127.8.149.126:40077
I20260808 08:52:19.257059 9849 heartbeater.cc:464] Registering TS with master...
I20260808 08:52:19.257745 9849 heartbeater.cc:511] Master 127.8.149.126:40077 requested a full tablet report, sending...
I20260808 08:52:19.259022 9120 ts_manager.cc:194] Registered new tserver with Master: 298670c794734df1a0da5e2ff0c0df67 (127.8.149.67:33375)
I20260808 08:52:19.259804 9120 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.149.67:42693
I20260808 08:52:19.262471 8789 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:52:19.271314 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.266213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56820 (local address 127.8.149.126:40077)
0808 08:52:19.266444 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.266451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.266800 (+ 349us) server_negotiation.cc:407] Connection header received
0808 08:52:19.266923 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.266927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.266990 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.267061 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:19.267519 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.268154 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.269362 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.269731 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.269821 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.270677 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:19.270680 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:19.270683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:19.270696 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:19.270722 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:19.270731 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:19.270790 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.270919 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.270978 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:52:19.274734 9120 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:52:19.281067 9120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:52:19.301221 9882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.292367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:44825 (local address 127.0.0.1:43758)
0808 08:52:19.293231 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.293253 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.293385 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.294353 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.294360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.294387 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:19.294728 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.294744 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.296656 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.296663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.298551 (+ 1888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.298565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.300415 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.300421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.300608 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.300657 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.300793 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.300956 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":666,"threads_started":1}
I20260808 08:52:19.301308 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.292875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43758 (local address 127.8.149.66:44825)
0808 08:52:19.293890 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.293896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.293919 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:52:19.293990 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.293995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.294152 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.294350 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:19.294948 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.296433 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.298813 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.300207 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.300369 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.300629 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.300836 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.301005 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":862,"thread_start_us":740,"threads_started":1}
I20260808 08:52:19.303231 9885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.293456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51458 (local address 127.8.149.65:37089)
0808 08:52:19.295822 (+ 2366us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.295830 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.295855 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:52:19.295956 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.295963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.296166 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.296343 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:19.296974 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.298422 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.300540 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.301830 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.301961 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.302214 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.302798 (+ 584us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.302948 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2205,"thread_start_us":2333,"threads_started":1}
I20260808 08:52:19.303267 9877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.291739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33375 (local address 127.0.0.1:44718)
0808 08:52:19.292404 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.292439 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.292621 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.295536 (+ 2915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.295541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.295577 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:19.295896 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.295907 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.297742 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.297747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.299977 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.299991 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.302527 (+ 2536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.302532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.302732 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.302757 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.302808 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.302926 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":26,"thread_start_us":423,"threads_started":1}
I20260808 08:52:19.303308 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.293029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:51458)
0808 08:52:19.295272 (+ 2243us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.295288 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.295389 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.296334 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.296338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.296359 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:19.296786 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.296800 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.298589 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.298595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.300330 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.300344 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.302334 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.302340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.302613 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.302651 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.302735 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.302873 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2133,"mutex_wait_us":675,"thread_start_us":1415,"threads_started":1}
I20260808 08:52:19.304265 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.292018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44718 (local address 127.8.149.67:33375)
0808 08:52:19.295042 (+ 3024us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.295051 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.295079 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:52:19.295156 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.295163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.295350 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.296056 (+ 706us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:19.296313 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.297612 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.300188 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.302326 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.303479 (+ 1153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.303731 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.303792 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.303923 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2870,"thread_start_us":2728,"threads_started":1}
I20260808 08:52:19.305277 9537 tablet_service.cc:1467] Processing CreateTablet for tablet e3cad4b896994226be346cf4cfed2d56 (DEFAULT_TABLE table=test-table [id=564e8439780a4be99d69c85eca38ffde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:19.306725 9537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3cad4b896994226be346cf4cfed2d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:19.307156 9316 tablet_service.cc:1467] Processing CreateTablet for tablet e3cad4b896994226be346cf4cfed2d56 (DEFAULT_TABLE table=test-table [id=564e8439780a4be99d69c85eca38ffde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:19.308267 9316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3cad4b896994226be346cf4cfed2d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:19.313613 9754 tablet_service.cc:1467] Processing CreateTablet for tablet e3cad4b896994226be346cf4cfed2d56 (DEFAULT_TABLE table=test-table [id=564e8439780a4be99d69c85eca38ffde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:52:19.314843 9754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3cad4b896994226be346cf4cfed2d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:19.318751 9891 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Bootstrap starting.
I20260808 08:52:19.320818 9892 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Bootstrap starting.
I20260808 08:52:19.322518 9891 tablet_bootstrap.cc:654] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:19.323796 9891 log.cc:824] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:19.323897 9892 tablet_bootstrap.cc:654] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:19.325163 9892 log.cc:824] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:19.328455 9892 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: No bootstrap required, opened a new log
I20260808 08:52:19.328768 9892 ts_tablet_manager.cc:1397] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260808 08:52:19.328814 9899 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Bootstrap starting.
I20260808 08:52:19.331652 9891 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: No bootstrap required, opened a new log
I20260808 08:52:19.331858 9899 tablet_bootstrap.cc:654] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:19.331913 9891 ts_tablet_manager.cc:1397] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260808 08:52:19.333055 9899 log.cc:824] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:19.335772 9899 tablet_bootstrap.cc:492] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: No bootstrap required, opened a new log
I20260808 08:52:19.335994 9899 ts_tablet_manager.cc:1397] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 08:52:19.338608 9892 raft_consensus.cc:348] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.339093 9892 raft_consensus.cc:374] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:19.339253 9892 raft_consensus.cc:729] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aa72f3409f846edb2412e56ebe55235, State: Initialized, Role: FOLLOWER
I20260808 08:52:19.339955 9892 consensus_queue.cc:260] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.343989 9891 raft_consensus.cc:348] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.344619 9891 raft_consensus.cc:374] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:19.344784 9891 raft_consensus.cc:729] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2738e1a2a7a47d2a614837fd4473bde, State: Initialized, Role: FOLLOWER
I20260808 08:52:19.345407 9899 raft_consensus.cc:348] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.345788 9899 raft_consensus.cc:374] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:19.345578 9891 consensus_queue.cc:260] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.346026 9899 raft_consensus.cc:729] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298670c794734df1a0da5e2ff0c0df67, State: Initialized, Role: FOLLOWER
I20260808 08:52:19.346560 9899 consensus_queue.cc:260] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.347877 9640 heartbeater.cc:503] Master 127.8.149.126:40077 was elected leader, sending a full tablet report...
I20260808 08:52:19.348120 9892 ts_tablet_manager.cc:1428] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Time spent starting tablet: real 0.019s user 0.011s sys 0.008s
I20260808 08:52:19.352473 9891 ts_tablet_manager.cc:1428] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Time spent starting tablet: real 0.020s user 0.018s sys 0.000s
I20260808 08:52:19.352852 9427 heartbeater.cc:503] Master 127.8.149.126:40077 was elected leader, sending a full tablet report...
I20260808 08:52:19.353523 9849 heartbeater.cc:503] Master 127.8.149.126:40077 was elected leader, sending a full tablet report...
I20260808 08:52:19.354382 9899 ts_tablet_manager.cc:1428] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
W20260808 08:52:19.354684 9428 tablet.cc:2369] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:52:19.382722 9905 raft_consensus.cc:482] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:52:19.383000 9905 raft_consensus.cc:504] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.384606 9905 leader_election.cc:288] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 298670c794734df1a0da5e2ff0c0df67 (127.8.149.67:33375), 5aa72f3409f846edb2412e56ebe55235 (127.8.149.66:44825)
I20260808 08:52:19.391376 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.385016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:60133 (local address 127.8.149.67:33375)
0808 08:52:19.385306 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.385312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.385967 (+ 655us) server_negotiation.cc:407] Connection header received
0808 08:52:19.386133 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.386138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.386202 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.386294 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:19.386898 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.387680 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.389653 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.390381 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.390556 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.390621 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.391068 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.391185 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 08:52:19.391410 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.384880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.66:44825 (local address 127.8.149.65:41347)
0808 08:52:19.385625 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.385661 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.385813 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.386133 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.386137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.386163 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:19.386503 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.386513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.387665 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.387670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.389335 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.389347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.390551 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.390557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.390740 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.390782 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.390869 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.390980 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":88,"thread_start_us":363,"threads_started":1}
I20260808 08:52:19.391407 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.385068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.8.149.65:41347 (local address 127.8.149.66:44825)
0808 08:52:19.385467 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.385475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.385757 (+ 282us) server_negotiation.cc:407] Connection header received
0808 08:52:19.385948 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.385952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.386021 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.386105 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:52:19.386661 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.387490 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.389546 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.390365 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.390519 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.390623 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.390930 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.391034 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264}
I20260808 08:52:19.392045 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.384946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.67:33375 (local address 127.8.149.65:60133)
0808 08:52:19.385855 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.385887 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:52:19.386004 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:52:19.386322 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:52:19.386325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:52:19.386343 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:52:19.386746 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.386759 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.387839 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.387842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.389428 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:52:19.389480 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.390733 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.390739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:52:19.390917 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.390944 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:52:19.391596 (+ 652us) client_negotiation.cc:240] Negotiation successful
0808 08:52:19.391707 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":804,"mutex_wait_us":37,"thread_start_us":594,"threads_started":1}
I20260808 08:52:19.392447 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3cad4b896994226be346cf4cfed2d56" candidate_uuid: "f2738e1a2a7a47d2a614837fd4473bde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa72f3409f846edb2412e56ebe55235" is_pre_election: true
I20260808 08:52:19.392906 9572 raft_consensus.cc:2454] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2738e1a2a7a47d2a614837fd4473bde in term 0.
I20260808 08:52:19.392876 9782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3cad4b896994226be346cf4cfed2d56" candidate_uuid: "f2738e1a2a7a47d2a614837fd4473bde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298670c794734df1a0da5e2ff0c0df67" is_pre_election: true
I20260808 08:52:19.393318 9782 raft_consensus.cc:2454] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2738e1a2a7a47d2a614837fd4473bde in term 0.
I20260808 08:52:19.393532 9243 leader_election.cc:302] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5aa72f3409f846edb2412e56ebe55235, f2738e1a2a7a47d2a614837fd4473bde; no voters:
I20260808 08:52:19.393913 9905 raft_consensus.cc:2781] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:52:19.394044 9905 raft_consensus.cc:482] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:52:19.394152 9905 raft_consensus.cc:3037] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:19.396174 9905 raft_consensus.cc:504] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.396654 9905 leader_election.cc:288] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [CANDIDATE]: Term 1 election: Requested vote from peers 298670c794734df1a0da5e2ff0c0df67 (127.8.149.67:33375), 5aa72f3409f846edb2412e56ebe55235 (127.8.149.66:44825)
I20260808 08:52:19.396976 9782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3cad4b896994226be346cf4cfed2d56" candidate_uuid: "f2738e1a2a7a47d2a614837fd4473bde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298670c794734df1a0da5e2ff0c0df67"
I20260808 08:52:19.397015 9572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3cad4b896994226be346cf4cfed2d56" candidate_uuid: "f2738e1a2a7a47d2a614837fd4473bde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa72f3409f846edb2412e56ebe55235"
I20260808 08:52:19.397172 9782 raft_consensus.cc:3037] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:19.397226 9572 raft_consensus.cc:3037] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:19.399387 9782 raft_consensus.cc:2454] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2738e1a2a7a47d2a614837fd4473bde in term 1.
I20260808 08:52:19.399808 9572 raft_consensus.cc:2454] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2738e1a2a7a47d2a614837fd4473bde in term 1.
I20260808 08:52:19.399808 9242 leader_election.cc:302] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298670c794734df1a0da5e2ff0c0df67, f2738e1a2a7a47d2a614837fd4473bde; no voters:
I20260808 08:52:19.400153 9905 raft_consensus.cc:2781] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:19.400664 9905 raft_consensus.cc:686] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 1 LEADER]: Becoming Leader. State: Replica: f2738e1a2a7a47d2a614837fd4473bde, State: Running, Role: LEADER
I20260808 08:52:19.401180 9905 consensus_queue.cc:237] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } }
I20260808 08:52:19.405398 9120 catalog_manager.cc:5495] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde reported cstate change: term changed from 0 to 1, leader changed from <none> to f2738e1a2a7a47d2a614837fd4473bde (127.8.149.65). New cstate: current_term: 1 leader_uuid: "f2738e1a2a7a47d2a614837fd4473bde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2738e1a2a7a47d2a614837fd4473bde" member_type: VOTER last_known_addr { host: "127.8.149.65" port: 37089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260808 08:52:19.425642 9885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.420745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51470 (local address 127.8.149.65:37089)
0808 08:52:19.420982 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.420988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.421030 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:52:19.421227 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.421231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.421326 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.421435 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:52:19.421757 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.422414 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.423738 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.424193 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.424283 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.424692 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:52:19.425128 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:52:19.425224 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.425318 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.425373 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:52:19.432695 9782 raft_consensus.cc:1261] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 1 FOLLOWER]: Refusing update from remote peer f2738e1a2a7a47d2a614837fd4473bde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:19.432698 9572 raft_consensus.cc:1261] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 1 FOLLOWER]: Refusing update from remote peer f2738e1a2a7a47d2a614837fd4473bde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:52:19.433492 9911 consensus_queue.cc:1035] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [LEADER]: Connected to new peer: Peer: permanent_uuid: "298670c794734df1a0da5e2ff0c0df67" member_type: VOTER last_known_addr { host: "127.8.149.67" port: 33375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:19.433796 9905 consensus_queue.cc:1035] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [LEADER]: Connected to new peer: Peer: permanent_uuid: "5aa72f3409f846edb2412e56ebe55235" member_type: VOTER last_known_addr { host: "127.8.149.66" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:52:19.444291 9918 mvcc.cc:205] Tried to move back new op lower bound from 7316189755108081664 to 7316189754991095808. Current Snapshot: MvccSnapshot[applied={T|T < 7316189755108081664}]
I20260808 08:52:19.444324 9916 mvcc.cc:205] Tried to move back new op lower bound from 7316189755108081664 to 7316189754991095808. Current Snapshot: MvccSnapshot[applied={T|T < 7316189755108081664}]
I20260808 08:52:19.447136 9920 mvcc.cc:205] Tried to move back new op lower bound from 7316189755108081664 to 7316189754991095808. Current Snapshot: MvccSnapshot[applied={T|T < 7316189755108081664}]
I20260808 08:52:19.456666 9118 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:19.456949 9118 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:52:19.460659 9118 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b14b962f7b24622b7d2016d86e068cf: Sending DeleteTablet for 3 replicas of tablet e3cad4b896994226be346cf4cfed2d56
I20260808 08:52:19.461665 9754 tablet_service.cc:1514] Processing DeleteTablet for tablet e3cad4b896994226be346cf4cfed2d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:19 UTC) from {username='slave'} at 127.0.0.1:44718
I20260808 08:52:19.461802 9537 tablet_service.cc:1514] Processing DeleteTablet for tablet e3cad4b896994226be346cf4cfed2d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:19 UTC) from {username='slave'} at 127.0.0.1:43758
I20260808 08:52:19.461802 9316 tablet_service.cc:1514] Processing DeleteTablet for tablet e3cad4b896994226be346cf4cfed2d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:52:19 UTC) from {username='slave'} at 127.0.0.1:51458
I20260808 08:52:19.462579 9932 tablet_replica.cc:330] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: stopping tablet replica
I20260808 08:52:19.463907 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9220
I20260808 08:52:19.471406 9932 raft_consensus.cc:2229] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:19.471905 9932 raft_consensus.cc:2258] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:19.474131 9932 ts_tablet_manager.cc:1905] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:19.481273 9932 ts_tablet_manager.cc:1918] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:19.481506 9932 log.cc:1196] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-2/wal/wals/e3cad4b896994226be346cf4cfed2d56
I20260808 08:52:19.482128 9932 ts_tablet_manager.cc:1939] T e3cad4b896994226be346cf4cfed2d56 P 298670c794734df1a0da5e2ff0c0df67: Deleting consensus metadata
I20260808 08:52:19.482733 9937 tablet_replica.cc:330] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: stopping tablet replica
I20260808 08:52:19.483465 9934 tablet_replica.cc:330] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: stopping tablet replica
I20260808 08:52:19.483922 9934 raft_consensus.cc:2229] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:52:19.484511 9097 catalog_manager.cc:4841] TS 298670c794734df1a0da5e2ff0c0df67 (127.8.149.67:33375): tablet e3cad4b896994226be346cf4cfed2d56 (table test-table [id=564e8439780a4be99d69c85eca38ffde]) successfully deleted
I20260808 08:52:19.484707 9934 raft_consensus.cc:2258] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:19.484033 9937 raft_consensus.cc:2229] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:52:19.486387 9885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.464833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.8.149.65:37089)
0808 08:52:19.465077 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.465086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.471399 (+ 6313us) server_negotiation.cc:407] Connection header received
0808 08:52:19.472467 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.472475 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.472591 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.472683 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:19.474059 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.475630 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.480380 (+ 4750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.481363 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.481493 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.484567 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:19.484580 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:19.484593 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:19.485416 (+ 823us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:19.485473 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:19.485522 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:19.485624 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.485908 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.486009 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:52:19.486593 9937 raft_consensus.cc:2258] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:52:19.486706 9934 ts_tablet_manager.cc:1905] T e3cad4b896994226be346cf4cfed2d56 P f2738e1a2a7a47d2a614837fd4473bde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:19.487483 9417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:19.488729 9937 ts_tablet_manager.cc:1905] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:52:19.494705 9937 ts_tablet_manager.cc:1918] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:52:19.494864 9937 log.cc:1196] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Deleting WAL directory at /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178813799529-8789-0/minicluster-data/ts-1/wal/wals/e3cad4b896994226be346cf4cfed2d56
I20260808 08:52:19.495325 9937 ts_tablet_manager.cc:1939] T e3cad4b896994226be346cf4cfed2d56 P 5aa72f3409f846edb2412e56ebe55235: Deleting consensus metadata
I20260808 08:52:19.496863 9098 catalog_manager.cc:4841] TS 5aa72f3409f846edb2412e56ebe55235 (127.8.149.66:44825): tablet e3cad4b896994226be346cf4cfed2d56 (table test-table [id=564e8439780a4be99d69c85eca38ffde]) successfully deleted
I20260808 08:52:19.581205 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9220
W20260808 08:52:19.608676 9097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.149.65:37089 (error 108)
I20260808 08:52:19.609818 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9438
I20260808 08:52:19.610594 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.610084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47108)
0808 08:52:19.610262 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.610383 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:52:19.610896 9097 catalog_manager.cc:4584] TS f2738e1a2a7a47d2a614837fd4473bde (127.8.149.65:37089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e3cad4b896994226be346cf4cfed2d56: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
I20260808 08:52:19.616699 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.610678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.8.149.66:44825)
0808 08:52:19.610860 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.610866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.610894 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:52:19.611017 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.611021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.611127 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.611254 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:19.611690 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.612406 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.613632 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.614062 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.614196 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.615269 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:19.615278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:19.615292 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:19.615867 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:19.615923 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:19.615946 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:19.616080 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.616255 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.616388 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:52:19.617355 9632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:19.664829 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.664266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47118)
0808 08:52:19.664544 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.664642 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260808 08:52:19.666064 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.665598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47132)
0808 08:52:19.665772 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.665877 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 08:52:19.721201 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9438
I20260808 08:52:19.734889 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.734411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47138)
0808 08:52:19.734612 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.734729 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 08:52:19.735858 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.735541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47142)
0808 08:52:19.735679 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.735751 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:52:19.751993 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9644
I20260808 08:52:19.758824 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.752823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42352 (local address 127.8.149.67:33375)
0808 08:52:19.752984 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:19.752988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:19.753025 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:52:19.753245 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:19.753252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:19.753372 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:19.753540 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:19.753928 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.754627 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.755957 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:19.756457 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:19.756552 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:19.757616 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:19.757624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:19.757639 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:19.758234 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:19.758279 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:19.758298 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:19.758400 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:19.758525 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 08:52:19.758606 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:52:19.759552 9840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:19.816263 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.815756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47152)
0808 08:52:19.815963 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.816051 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:52:19.817265 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:19.816924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.65:37089 (local address 127.0.0.1:47156)
0808 08:52:19.817104 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:52:19.817166 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.65:37089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 08:52:19.846393 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9644
I20260808 08:52:19.873503 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9066
I20260808 08:52:19.874553 9170 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:19.980161 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9066
2026-08-08T08:52:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2754 ms)
[----------] 6 tests from EncryptionPolicyTest (22623 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:20 dist-test-slave-7vjv krb5kdc[9950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:20 dist-test-slave-7vjv krb5kdc[9950](info): set up 2 sockets
Aug 08 08:52:20 dist-test-slave-7vjv krb5kdc[9950](info): commencing operation
krb5kdc: starting...
W20260808 08:52:21.282357 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.003s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:21 dist-test-slave-7vjv krb5kdc[9950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:21.553279 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36217
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:21.881204 9968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:21.881464 9968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:21.881618 9968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:21.888432 9968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:21.888525 9968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:21.888646 9968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:21.888749 9968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:21.888815 9968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:21.898190 9968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36217
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:21.899271 9968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:21.900477 9968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:21.911826 9979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:21.911913 9975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:21.911913 9977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:21.913062 9968 server_base.cc:1034] running on GCE node
I20260808 08:52:21.913765 9968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:21.915027 9968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:21.916273 9968 hybrid_clock.cc:648] HybridClock initialized: now 1786179141916219 us; error 43 us; skew 500 ppm
I20260808 08:52:21.916632 9968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:21 dist-test-slave-7vjv krb5kdc[9950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179141, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:21.919562 9968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:21.921000 9968 webserver.cc:460] Webserver started at http://127.0.0.1:39395/ using document root <none> and password file <none>
I20260808 08:52:21.921535 9968 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:21.921623 9968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:21.921837 9968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:21.924379 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "0437729504a94440bd21bd1d9a88d6b0"
format_stamp: "Formatted at 2026-08-08 08:52:21 on dist-test-slave-7vjv"
server_key: "9315468771977f92c7c51475a1cee49b"
server_key_iv: "31d9516bb105dc4bb4da52ac31faa960"
server_key_version: "encryptionkey@0"
I20260808 08:52:21.925061 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "0437729504a94440bd21bd1d9a88d6b0"
format_stamp: "Formatted at 2026-08-08 08:52:21 on dist-test-slave-7vjv"
server_key: "9315468771977f92c7c51475a1cee49b"
server_key_iv: "31d9516bb105dc4bb4da52ac31faa960"
server_key_version: "encryptionkey@0"
I20260808 08:52:21.929759 9968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:52:21.932910 9991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:21.934082 9968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:52:21.934262 9968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "0437729504a94440bd21bd1d9a88d6b0"
format_stamp: "Formatted at 2026-08-08 08:52:21 on dist-test-slave-7vjv"
server_key: "9315468771977f92c7c51475a1cee49b"
server_key_iv: "31d9516bb105dc4bb4da52ac31faa960"
server_key_version: "encryptionkey@0"
I20260808 08:52:21.934439 9968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:21.959133 9968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:21.962669 9968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:21.962931 9968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:21.981401 9968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36217
I20260808 08:52:21.981454 10066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36217 every 8 connection(s)
I20260808 08:52:21.982705 9968 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:21.986068 10067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:21.989413 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 9968
I20260808 08:52:21.989650 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:21.990302 8789 external_mini_cluster.cc:1428] Setting key b93f6cad5bbd55b8edef3e5f8be4ceb1
I20260808 08:52:21.998410 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0: Bootstrap starting.
I20260808 08:52:22.001976 10067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:22.003274 10067 log.cc:824] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:52:22 dist-test-slave-7vjv krb5kdc[9950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:52:22.006500 10067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0: No bootstrap required, opened a new log
I20260808 08:52:22.013609 10072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:21.992180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33589 (local address 127.0.0.1:36217)
0808 08:52:21.992981 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:21.992992 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:21.993029 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:52:21.994554 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:21.994574 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:21.994929 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:21.995262 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:21.996991 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:21.998206 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:21.999942 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:22.000593 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:22.000722 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:22.006010 (+ 5288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:22.006018 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:22.006030 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:22.006062 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:22.009417 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:22.010376 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:22.010383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:22.010388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:22.010617 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:22.011104 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:22.011108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:22.011110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:22.011605 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:22.011913 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:22.012408 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 08:52:22.012758 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":349,"threads_started":1}
I20260808 08:52:22.015089 10067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } }
I20260808 08:52:22.015460 10067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:22.015569 10067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0437729504a94440bd21bd1d9a88d6b0, State: Initialized, Role: FOLLOWER
I20260808 08:52:22.016235 10067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } }
I20260808 08:52:22.016497 10067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:22.016628 10067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:22.016811 10067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:22.017580 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:22.019505 10067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } }
I20260808 08:52:22.020057 10067 leader_election.cc:302] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0437729504a94440bd21bd1d9a88d6b0; no voters:
I20260808 08:52:22.020727 10067 leader_election.cc:288] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:22.020841 10076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:22.023056 10067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:22.024480 10076 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [term 1 LEADER]: Becoming Leader. State: Replica: 0437729504a94440bd21bd1d9a88d6b0, State: Running, Role: LEADER
I20260808 08:52:22.025750 10076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } }
I20260808 08:52:22.029598 10081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0437729504a94440bd21bd1d9a88d6b0. Latest consensus state: current_term: 1 leader_uuid: "0437729504a94440bd21bd1d9a88d6b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } } }
I20260808 08:52:22.030030 10081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:22.030617 10080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0437729504a94440bd21bd1d9a88d6b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0437729504a94440bd21bd1d9a88d6b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36217 } } }
I20260808 08:52:22.030975 10080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:22.051927 10090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:22.060132 10090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:22.079490 10090 catalog_manager.cc:1347] Generated new cluster ID: 3433f09207414cf1b43846638cdbd0eb
I20260808 08:52:22.080040 10090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:22.089785 10072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:22.062145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54055 (local address 127.0.0.1:36217)
0808 08:52:22.062323 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:22.062328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:22.067889 (+ 5561us) server_negotiation.cc:407] Connection header received
0808 08:52:22.068200 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:22.068205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:22.068279 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:22.068359 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:22.070477 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:22.071803 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:22.074300 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:22.075173 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:22.075300 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:22.078829 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:22.078839 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:22.078845 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:22.078883 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:22.084348 (+ 5465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:22.085646 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:22.085654 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:22.085660 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:22.085839 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:22.086585 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:22.086593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:22.086598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:22.087111 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:22.088801 (+ 1690us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:22.089020 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 08:52:22.089251 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:52:22.097007 10090 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:22.098712 10090 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:22.112425 10090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0437729504a94440bd21bd1d9a88d6b0: Generated new TSK 0
I20260808 08:52:22.113164 10090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:22.120818 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 9968
I20260808 08:52:22.122963 10061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:22.211570 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 9968
W20260808 08:52:22.240679 9948 connection.cc:535] client connection to 127.0.0.1:36217 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36217): Connection reset by peer (error 104)
2026-08-08T08:52:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2223 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:22 dist-test-slave-7vjv krb5kdc[10120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:22 dist-test-slave-7vjv krb5kdc[10120](info): set up 2 sockets
Aug 08 08:52:22 dist-test-slave-7vjv krb5kdc[10120](info): commencing operation
krb5kdc: starting...
W20260808 08:52:23.496526 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:23 dist-test-slave-7vjv krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:23.763159 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:24.096002 10142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:24.096329 10142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:24.096503 10142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:24.103246 10142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:24.103374 10142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:24.103473 10142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:24.103574 10142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:24.103657 10142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:24.112694 10142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43475
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:24.113837 10142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:24.115088 10142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:24.126744 10150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:24.126688 10155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:24.126714 10157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:24.127378 10142 server_base.cc:1034] running on GCE node
I20260808 08:52:24.128038 10142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:24.129289 10142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:24.130481 10142 hybrid_clock.cc:648] HybridClock initialized: now 1786179144130430 us; error 51 us; skew 500 ppm
I20260808 08:52:24.130822 10142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:24 dist-test-slave-7vjv krb5kdc[10120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179144, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:24.136647 10142 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:24.138109 10142 webserver.cc:460] Webserver started at http://127.0.0.1:33383/ using document root <none> and password file <none>
I20260808 08:52:24.138720 10142 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:24.138823 10142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:24.139063 10142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:24.141875 10142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "38e4731f76394245aa17a29c03a5f7fd"
format_stamp: "Formatted at 2026-08-08 08:52:24 on dist-test-slave-7vjv"
server_key: "c63e147d0fa81ac490fca89c5d3107ab"
server_key_iv: "89a725a36acaca98dd07e7ef30285612"
server_key_version: "encryptionkey@0"
I20260808 08:52:24.142535 10142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "38e4731f76394245aa17a29c03a5f7fd"
format_stamp: "Formatted at 2026-08-08 08:52:24 on dist-test-slave-7vjv"
server_key: "c63e147d0fa81ac490fca89c5d3107ab"
server_key_iv: "89a725a36acaca98dd07e7ef30285612"
server_key_version: "encryptionkey@0"
I20260808 08:52:24.147182 10142 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260808 08:52:24.150274 10164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:24.151489 10142 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:52:24.151687 10142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "38e4731f76394245aa17a29c03a5f7fd"
format_stamp: "Formatted at 2026-08-08 08:52:24 on dist-test-slave-7vjv"
server_key: "c63e147d0fa81ac490fca89c5d3107ab"
server_key_iv: "89a725a36acaca98dd07e7ef30285612"
server_key_version: "encryptionkey@0"
I20260808 08:52:24.151871 10142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:24.171890 10142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:24.175648 10142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:24.175927 10142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:24.194471 10142 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43475
I20260808 08:52:24.194514 10242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43475 every 8 connection(s)
I20260808 08:52:24.195693 10142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:24.198871 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10142
I20260808 08:52:24.199054 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:24.199492 10245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:24.199676 8789 external_mini_cluster.cc:1428] Setting key ec143e57258230eebad682b6771b2d81
I20260808 08:52:24.211532 10245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd: Bootstrap starting.
I20260808 08:52:24.212059 10250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:24.201299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38017 (local address 127.0.0.1:43475)
0808 08:52:24.202031 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:24.202049 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:24.202104 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:52:24.204202 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:24.204221 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:24.204565 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:24.204957 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:24.205499 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:24.206740 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:24.207976 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:24.208666 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:24.208862 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:24.210053 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:24.210059 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:24.210071 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:24.210520 (+ 449us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:24.210594 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:24.210621 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:24.210773 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:24.211022 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 08:52:24.211166 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":340,"threads_started":1}
I20260808 08:52:24.214682 10245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:24.215739 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:24.215962 10245 log.cc:824] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:24.218482 10245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd: No bootstrap required, opened a new log
I20260808 08:52:24.225742 10245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 08:52:24.226138 10245 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:24.226229 10245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e4731f76394245aa17a29c03a5f7fd, State: Initialized, Role: FOLLOWER
I20260808 08:52:24.226743 10245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 08:52:24.227001 10245 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:24.227155 10245 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:24.227322 10245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:24.230306 10245 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 08:52:24.230544 10250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:24.220484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33849 (local address 127.0.0.1:43475)
0808 08:52:24.220673 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:24.220679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:24.224596 (+ 3917us) server_negotiation.cc:407] Connection header received
0808 08:52:24.224742 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:24.224747 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:24.224818 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:24.224929 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:24.225338 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:24.226309 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:24.227878 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:24.228613 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:24.228767 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:24.229818 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:24.229823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:24.229827 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:24.229845 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:24.229884 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:24.229902 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:24.229999 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:24.230160 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 08:52:24.230208 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:52:24.230932 10245 leader_election.cc:302] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38e4731f76394245aa17a29c03a5f7fd; no voters:
I20260808 08:52:24.231657 10245 leader_election.cc:288] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:24.231755 10258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:24.232568 10258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [term 1 LEADER]: Becoming Leader. State: Replica: 38e4731f76394245aa17a29c03a5f7fd, State: Running, Role: LEADER
I20260808 08:52:24.233143 10258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } }
I20260808 08:52:24.233911 10245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:24.235934 10262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38e4731f76394245aa17a29c03a5f7fd. Latest consensus state: current_term: 1 leader_uuid: "38e4731f76394245aa17a29c03a5f7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } } }
I20260808 08:52:24.236044 10261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38e4731f76394245aa17a29c03a5f7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38e4731f76394245aa17a29c03a5f7fd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43475 } } }
I20260808 08:52:24.236429 10262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:24.236457 10261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:24.238761 10272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:24.243191 10272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:24.251242 10272 catalog_manager.cc:1347] Generated new cluster ID: e7c6ce9282ef453f8e0e445054435bb6
I20260808 08:52:24.251410 10272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:24.265432 10272 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:24.266732 10272 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:24.275161 10272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38e4731f76394245aa17a29c03a5f7fd: Generated new TSK 0
I20260808 08:52:24.275846 10272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:24.285362 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10142
W20260808 08:52:24.286969 10238 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38017
W20260808 08:52:24.287715 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10142: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:24.287914 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10142
W20260808 08:52:24.317073 10116 connection.cc:535] client connection to 127.0.0.1:43475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43475): Connection reset by peer (error 104)
2026-08-08T08:52:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2076 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:24 dist-test-slave-7vjv krb5kdc[10291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:24 dist-test-slave-7vjv krb5kdc[10291](info): set up 2 sockets
Aug 08 08:52:24 dist-test-slave-7vjv krb5kdc[10291](info): commencing operation
krb5kdc: starting...
W20260808 08:52:25.613664 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:25 dist-test-slave-7vjv krb5kdc[10291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:25.886773 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45015
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:26.219552 10309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:26.219907 10309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:26.220069 10309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:26.226550 10309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:26.226682 10309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:26.226796 10309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:26.226909 10309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:26.226981 10309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:26.236150 10309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45015
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:26.237334 10309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:26.238582 10309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:26.250283 10319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:26.250313 10316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:26.250579 10315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:26.251240 10309 server_base.cc:1034] running on GCE node
I20260808 08:52:26.252027 10309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:26.253357 10309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:26.254578 10309 hybrid_clock.cc:648] HybridClock initialized: now 1786179146254526 us; error 45 us; skew 500 ppm
I20260808 08:52:26.254902 10309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:26 dist-test-slave-7vjv krb5kdc[10291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179146, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:26.258169 10309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:26.259696 10309 webserver.cc:460] Webserver started at http://127.0.0.1:44833/ using document root <none> and password file <none>
I20260808 08:52:26.260468 10309 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:26.260601 10309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:26.260932 10309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:26.263651 10309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "2dff472bde4a4d069add62d1d9b41289"
format_stamp: "Formatted at 2026-08-08 08:52:26 on dist-test-slave-7vjv"
server_key: "160aab8233dca6cd1a352d770a653df5"
server_key_iv: "1e88627cc1b83e5bcd804db3cc3b4a2c"
server_key_version: "encryptionkey@0"
I20260808 08:52:26.264456 10309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "2dff472bde4a4d069add62d1d9b41289"
format_stamp: "Formatted at 2026-08-08 08:52:26 on dist-test-slave-7vjv"
server_key: "160aab8233dca6cd1a352d770a653df5"
server_key_iv: "1e88627cc1b83e5bcd804db3cc3b4a2c"
server_key_version: "encryptionkey@0"
I20260808 08:52:26.269618 10309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:52:26.273181 10334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:26.274915 10309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:52:26.275164 10309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "2dff472bde4a4d069add62d1d9b41289"
format_stamp: "Formatted at 2026-08-08 08:52:26 on dist-test-slave-7vjv"
server_key: "160aab8233dca6cd1a352d770a653df5"
server_key_iv: "1e88627cc1b83e5bcd804db3cc3b4a2c"
server_key_version: "encryptionkey@0"
I20260808 08:52:26.275485 10309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:26.281899 10309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:26.286079 10309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:26.286464 10309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:26.305634 10309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45015
I20260808 08:52:26.305709 10425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45015 every 8 connection(s)
I20260808 08:52:26.306967 10309 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:26.310123 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10309
I20260808 08:52:26.310323 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:26.310472 10426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:26.310875 8789 external_mini_cluster.cc:1428] Setting key 3c2081a819f68ce7301f075d204f17df
I20260808 08:52:26.317932 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:26.312531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32991 (local address 127.0.0.1:45015)
0808 08:52:26.313326 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:26.313336 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:26.313380 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:52:26.314828 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:26.314846 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:26.315155 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:26.315461 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:26.316471 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:26.316477 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:26.316491 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:26.316505 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:26.316568 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:26.316593 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:26.316771 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:26.316910 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 08:52:26.317125 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":389,"threads_started":1}
I20260808 08:52:26.321532 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:26.322458 10426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289: Bootstrap starting.
I20260808 08:52:26.325337 10426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:26.326455 10426 log.cc:824] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:26.328679 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:26.326168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44873 (local address 127.0.0.1:45015)
0808 08:52:26.326340 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:26.326345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:26.326759 (+ 414us) server_negotiation.cc:407] Connection header received
0808 08:52:26.326898 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:26.326906 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:26.326980 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:26.327095 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:26.328055 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:26.328060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:26.328064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:26.328080 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:26.328138 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:26.328161 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:26.328267 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:26.328377 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:52:26.328425 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:52:26.329689 10426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289: No bootstrap required, opened a new log
I20260808 08:52:26.337704 10426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } }
I20260808 08:52:26.338172 10426 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:26.338281 10426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dff472bde4a4d069add62d1d9b41289, State: Initialized, Role: FOLLOWER
I20260808 08:52:26.338959 10426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } }
I20260808 08:52:26.339257 10426 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:26.339422 10426 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:26.339648 10426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:26.342242 10426 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } }
I20260808 08:52:26.342700 10426 leader_election.cc:302] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dff472bde4a4d069add62d1d9b41289; no voters:
I20260808 08:52:26.343228 10426 leader_election.cc:288] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:26.343408 10442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:26.344164 10442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [term 1 LEADER]: Becoming Leader. State: Replica: 2dff472bde4a4d069add62d1d9b41289, State: Running, Role: LEADER
I20260808 08:52:26.344728 10442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } }
I20260808 08:52:26.345151 10426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:26.347555 10443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dff472bde4a4d069add62d1d9b41289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } } }
I20260808 08:52:26.347647 10444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dff472bde4a4d069add62d1d9b41289. Latest consensus state: current_term: 1 leader_uuid: "2dff472bde4a4d069add62d1d9b41289" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dff472bde4a4d069add62d1d9b41289" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45015 } } }
I20260808 08:52:26.348016 10443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:26.348011 10444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:26.348929 10449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:26.354619 10449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:26.362713 10449 catalog_manager.cc:1347] Generated new cluster ID: c68a3b493cd44a138e74d1e26b330c2f
I20260808 08:52:26.362845 10449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:26.406829 10449 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:26.407337 10449 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:26.414942 10449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dff472bde4a4d069add62d1d9b41289: Generated new TSK 0
I20260808 08:52:26.415665 10449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:26.426236 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10309
W20260808 08:52:26.427891 10421 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:32991
W20260808 08:52:26.428654 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10309: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:26.428803 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10309
2026-08-08T08:52:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2140 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:26 dist-test-slave-7vjv krb5kdc[10475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:26 dist-test-slave-7vjv krb5kdc[10475](info): set up 2 sockets
Aug 08 08:52:26 dist-test-slave-7vjv krb5kdc[10475](info): commencing operation
krb5kdc: starting...
W20260808 08:52:27.721503 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:27 dist-test-slave-7vjv krb5kdc[10475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:27.998723 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36185
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:28.338572 10489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:28.338969 10489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:28.339128 10489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:28.348186 10489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:28.348301 10489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:28.348348 10489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:28.348412 10489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:28.348456 10489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:28.357743 10489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:28.358945 10489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:28.360234 10489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:28.372140 10495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:28.372157 10500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:28.372171 10503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:28.373612 10489 server_base.cc:1034] running on GCE node
I20260808 08:52:28.374440 10489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:28.375809 10489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:28.377174 10489 hybrid_clock.cc:648] HybridClock initialized: now 1786179148377117 us; error 37 us; skew 500 ppm
I20260808 08:52:28.377593 10489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:28 dist-test-slave-7vjv krb5kdc[10475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179148, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:28.380923 10489 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:28.382515 10489 webserver.cc:460] Webserver started at http://127.0.0.1:36883/ using document root <none> and password file <none>
I20260808 08:52:28.383227 10489 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:28.383440 10489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:28.383785 10489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:28.386848 10489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57"
format_stamp: "Formatted at 2026-08-08 08:52:28 on dist-test-slave-7vjv"
server_key: "e5235263c72c6e9a6ceded289dffef70"
server_key_iv: "3301adff3948224744186c877feb42cb"
server_key_version: "encryptionkey@0"
I20260808 08:52:28.387673 10489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57"
format_stamp: "Formatted at 2026-08-08 08:52:28 on dist-test-slave-7vjv"
server_key: "e5235263c72c6e9a6ceded289dffef70"
server_key_iv: "3301adff3948224744186c877feb42cb"
server_key_version: "encryptionkey@0"
I20260808 08:52:28.392851 10489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 08:52:28.396080 10514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:28.397305 10489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:52:28.397505 10489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57"
format_stamp: "Formatted at 2026-08-08 08:52:28 on dist-test-slave-7vjv"
server_key: "e5235263c72c6e9a6ceded289dffef70"
server_key_iv: "3301adff3948224744186c877feb42cb"
server_key_version: "encryptionkey@0"
I20260808 08:52:28.397711 10489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:28.411794 10489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:28.415648 10489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:28.415948 10489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:28.436064 10489 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36185
I20260808 08:52:28.436154 10594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36185 every 8 connection(s)
I20260808 08:52:28.437503 10489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:28.441051 10595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:28.443580 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10489
I20260808 08:52:28.443765 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:28.444227 8789 external_mini_cluster.cc:1428] Setting key cf097849ed0644b046c7c702b7d5c55a
I20260808 08:52:28.452498 10595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57: Bootstrap starting.
I20260808 08:52:28.455977 10595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:28.457255 10595 log.cc:824] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:52:28 dist-test-slave-7vjv krb5kdc[10475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:52:28.460057 10595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57: No bootstrap required, opened a new log
I20260808 08:52:28.467926 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:28.445981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33701 (local address 127.0.0.1:36185)
0808 08:52:28.446724 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:28.446734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:28.446773 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:52:28.448476 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:28.448496 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:28.448872 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:28.449152 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:28.450881 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:28.452206 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:28.453904 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:28.454547 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:28.454674 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:28.459814 (+ 5140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:28.459823 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:28.459836 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:28.459882 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:28.463609 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:28.464515 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:28.464522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:28.464527 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:28.464702 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:28.465146 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:28.465169 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:28.465172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:28.465742 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:28.466088 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:28.466586 (+ 498us) server_negotiation.cc:299] Negotiation successful
0808 08:52:28.466998 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":383,"threads_started":1}
I20260808 08:52:28.467875 10595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } }
I20260808 08:52:28.468321 10595 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:28.468464 10595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c9f34a7b2da4e5fa524d41af0e1fc57, State: Initialized, Role: FOLLOWER
I20260808 08:52:28.469030 10595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } }
I20260808 08:52:28.469269 10595 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:28.470302 10595 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:28.470526 10595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:28.472189 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:28.473179 10595 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } }
I20260808 08:52:28.473631 10595 leader_election.cc:302] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c9f34a7b2da4e5fa524d41af0e1fc57; no voters:
I20260808 08:52:28.474277 10595 leader_election.cc:288] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:28.474366 10603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:28.476697 10595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:28.480464 10603 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [term 1 LEADER]: Becoming Leader. State: Replica: 6c9f34a7b2da4e5fa524d41af0e1fc57, State: Running, Role: LEADER
I20260808 08:52:28.481176 10603 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } }
I20260808 08:52:28.485013 10604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } } }
I20260808 08:52:28.487121 10604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:28.485400 10608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c9f34a7b2da4e5fa524d41af0e1fc57. Latest consensus state: current_term: 1 leader_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c9f34a7b2da4e5fa524d41af0e1fc57" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36185 } } }
I20260808 08:52:28.487676 10608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:28.490105 10631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:28.495419 10631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:28.503433 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:28.483708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41015 (local address 127.0.0.1:36185)
0808 08:52:28.484036 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:28.484045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:28.484641 (+ 596us) server_negotiation.cc:407] Connection header received
0808 08:52:28.484887 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:28.484895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:28.485003 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:28.485141 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:28.486763 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:28.487845 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:28.489654 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:28.490396 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:28.490539 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:28.494120 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:28.494130 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:28.494137 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:28.494180 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:28.498619 (+ 4439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:28.499651 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:28.499658 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:28.499681 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:28.499863 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:28.500454 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:28.500462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:28.500467 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:28.501042 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:28.501299 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:28.502700 (+ 1401us) server_negotiation.cc:299] Negotiation successful
0808 08:52:28.502957 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260808 08:52:28.511145 10631 catalog_manager.cc:1347] Generated new cluster ID: fafe993e5d2747d99c725fea80f84420
I20260808 08:52:28.511278 10631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:28.523007 10631 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:28.524051 10631 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:28.530869 10631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c9f34a7b2da4e5fa524d41af0e1fc57: Generated new TSK 0
I20260808 08:52:28.531752 10631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:28.540110 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10489
I20260808 08:52:28.541445 10588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:28.626518 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10489
2026-08-08T08:52:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2191 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:28 dist-test-slave-7vjv krb5kdc[10656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:28 dist-test-slave-7vjv krb5kdc[10656](info): set up 2 sockets
Aug 08 08:52:28 dist-test-slave-7vjv krb5kdc[10656](info): commencing operation
krb5kdc: starting...
W20260808 08:52:29.938918 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:30 dist-test-slave-7vjv krb5kdc[10656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:30.233836 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:30.564466 10680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:30.564793 10680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:30.564987 10680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:30.571947 10680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:30.572106 10680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:30.572238 10680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:30.572353 10680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:30.572444 10680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:30.581830 10680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:30.583112 10680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:30.584429 10680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:30.595983 10686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:30.596032 10693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:30.596086 10687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:30.596844 10680 server_base.cc:1034] running on GCE node
I20260808 08:52:30.597556 10680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:30.598765 10680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:30.600003 10680 hybrid_clock.cc:648] HybridClock initialized: now 1786179150599977 us; error 40 us; skew 500 ppm
I20260808 08:52:30.600378 10680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:30 dist-test-slave-7vjv krb5kdc[10656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179150, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:30.603551 10680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:30.605041 10680 webserver.cc:460] Webserver started at http://127.0.0.1:37951/ using document root <none> and password file <none>
I20260808 08:52:30.605693 10680 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:30.605844 10680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:30.606155 10680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:30.609066 10680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "587a58946cde4ba8ab95348169e27f87"
format_stamp: "Formatted at 2026-08-08 08:52:30 on dist-test-slave-7vjv"
server_key: "4562000f36ed164927e172632598bbd1"
server_key_iv: "102396d3cf97c353ef9a697c2ea1b1f5"
server_key_version: "encryptionkey@0"
I20260808 08:52:30.609863 10680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "587a58946cde4ba8ab95348169e27f87"
format_stamp: "Formatted at 2026-08-08 08:52:30 on dist-test-slave-7vjv"
server_key: "4562000f36ed164927e172632598bbd1"
server_key_iv: "102396d3cf97c353ef9a697c2ea1b1f5"
server_key_version: "encryptionkey@0"
I20260808 08:52:30.614928 10680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 08:52:30.618299 10702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:30.619582 10680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:52:30.619792 10680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "587a58946cde4ba8ab95348169e27f87"
format_stamp: "Formatted at 2026-08-08 08:52:30 on dist-test-slave-7vjv"
server_key: "4562000f36ed164927e172632598bbd1"
server_key_iv: "102396d3cf97c353ef9a697c2ea1b1f5"
server_key_version: "encryptionkey@0"
I20260808 08:52:30.619997 10680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:30.633827 10680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:30.637434 10680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:30.637687 10680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:30.656528 10680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44003
I20260808 08:52:30.656571 10800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44003 every 8 connection(s)
I20260808 08:52:30.657826 10680 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:30.660434 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10680
I20260808 08:52:30.660625 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:30.661067 8789 external_mini_cluster.cc:1428] Setting key 6f482a251cc73c630dcb58490fb291fb
I20260808 08:52:30.661381 10801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:30.673122 10801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87: Bootstrap starting.
I20260808 08:52:30.675614 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:30.662777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48777 (local address 127.0.0.1:44003)
0808 08:52:30.663512 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:30.663522 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:30.663558 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:52:30.666061 (+ 2503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:30.666083 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:30.666467 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:30.666988 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:30.667625 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:30.669084 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:30.670614 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:30.671393 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:30.671644 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:30.672956 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:30.672966 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:30.672979 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:30.673649 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:30.673737 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:30.673766 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:30.673935 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:30.674217 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 08:52:30.674519 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":353,"threads_started":1}
I20260808 08:52:30.676450 10801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:30.677567 10801 log.cc:824] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:30.679863 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:30.680431 10801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87: No bootstrap required, opened a new log
I20260808 08:52:30.688628 10801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } }
I20260808 08:52:30.689069 10801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:30.689175 10801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 587a58946cde4ba8ab95348169e27f87, State: Initialized, Role: FOLLOWER
I20260808 08:52:30.689843 10801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } }
I20260808 08:52:30.690137 10801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:30.690290 10801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:30.690474 10801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:30.691741 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:30.685057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38779 (local address 127.0.0.1:44003)
0808 08:52:30.685310 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:30.685317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:30.685695 (+ 378us) server_negotiation.cc:407] Connection header received
0808 08:52:30.685902 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:30.685906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:30.685977 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:30.686066 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:30.686663 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:30.687387 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:30.689319 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:30.689742 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:30.689838 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:30.691024 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:30.691032 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:30.691034 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:30.691049 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:30.691085 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:30.691098 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:30.691174 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:30.691328 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 08:52:30.691392 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:52:30.693154 10801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } }
I20260808 08:52:30.693634 10801 leader_election.cc:302] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 587a58946cde4ba8ab95348169e27f87; no voters:
I20260808 08:52:30.694330 10801 leader_election.cc:288] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:30.694595 10814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:30.696022 10814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [term 1 LEADER]: Becoming Leader. State: Replica: 587a58946cde4ba8ab95348169e27f87, State: Running, Role: LEADER
I20260808 08:52:30.696672 10801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:30.696954 10814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } }
I20260808 08:52:30.700322 10818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 587a58946cde4ba8ab95348169e27f87. Latest consensus state: current_term: 1 leader_uuid: "587a58946cde4ba8ab95348169e27f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } } }
I20260808 08:52:30.700816 10818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:30.701344 10817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "587a58946cde4ba8ab95348169e27f87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587a58946cde4ba8ab95348169e27f87" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44003 } } }
I20260808 08:52:30.701788 10817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:30.703189 10826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:30.707863 10826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:30.717639 10826 catalog_manager.cc:1347] Generated new cluster ID: 95c5fae22e8e4f0aa9f104fa3f0b8e9f
I20260808 08:52:30.717737 10826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:30.726824 10826 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:30.728272 10826 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:30.742825 10826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 587a58946cde4ba8ab95348169e27f87: Generated new TSK 0
I20260808 08:52:30.743647 10826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:30.750262 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10680
W20260808 08:52:30.751250 10793 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48777
W20260808 08:52:30.752130 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10680: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:30.752297 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10680
2026-08-08T08:52:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2131 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:30 dist-test-slave-7vjv krb5kdc[10851](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:30 dist-test-slave-7vjv krb5kdc[10851](info): set up 2 sockets
Aug 08 08:52:30 dist-test-slave-7vjv krb5kdc[10851](info): commencing operation
krb5kdc: starting...
W20260808 08:52:32.064646 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.005s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:32 dist-test-slave-7vjv krb5kdc[10851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:32.358814 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:32.685995 10875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:32.686312 10875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:32.686481 10875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:32.693608 10875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:32.693753 10875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:32.693859 10875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:32.694017 10875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:32.694110 10875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:32.703419 10875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:32.704669 10875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:32.705906 10875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:32.717622 10883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:32.717658 10884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:32.717686 10886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:32.719043 10875 server_base.cc:1034] running on GCE node
I20260808 08:52:32.719753 10875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:32.721124 10875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:32.722347 10875 hybrid_clock.cc:648] HybridClock initialized: now 1786179152722318 us; error 46 us; skew 500 ppm
I20260808 08:52:32.722698 10875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:32 dist-test-slave-7vjv krb5kdc[10851](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179152, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:32.725807 10875 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:32.727180 10875 webserver.cc:460] Webserver started at http://127.0.0.1:35423/ using document root <none> and password file <none>
I20260808 08:52:32.727895 10875 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:32.728047 10875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:32.728386 10875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:32.731254 10875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "33cd8da7c51f45209e842c740acb1f28"
format_stamp: "Formatted at 2026-08-08 08:52:32 on dist-test-slave-7vjv"
server_key: "da56293e735f5d9115b6692bf4e8027e"
server_key_iv: "4039122e080082538d62f50d14eff603"
server_key_version: "encryptionkey@0"
I20260808 08:52:32.732031 10875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "33cd8da7c51f45209e842c740acb1f28"
format_stamp: "Formatted at 2026-08-08 08:52:32 on dist-test-slave-7vjv"
server_key: "da56293e735f5d9115b6692bf4e8027e"
server_key_iv: "4039122e080082538d62f50d14eff603"
server_key_version: "encryptionkey@0"
I20260808 08:52:32.736929 10875 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:52:32.740327 10899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:32.741710 10875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:52:32.741931 10875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "33cd8da7c51f45209e842c740acb1f28"
format_stamp: "Formatted at 2026-08-08 08:52:32 on dist-test-slave-7vjv"
server_key: "da56293e735f5d9115b6692bf4e8027e"
server_key_iv: "4039122e080082538d62f50d14eff603"
server_key_version: "encryptionkey@0"
I20260808 08:52:32.742193 10875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:32.747977 10875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:32.751868 10875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:32.752341 10875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:32.772706 10875 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34271
I20260808 08:52:32.772750 10984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34271 every 8 connection(s)
I20260808 08:52:32.774020 10875 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:32.777400 10985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:32.784299 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 10875
I20260808 08:52:32.784484 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:32.785037 8789 external_mini_cluster.cc:1428] Setting key f07c0314597577bb3f9c4301dec22854
I20260808 08:52:32.787858 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28: Bootstrap starting.
I20260808 08:52:32.791327 10985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:32.792479 10985 log.cc:824] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:32.792725 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:32.786768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33483 (local address 127.0.0.1:34271)
0808 08:52:32.787581 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:32.787591 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:32.787630 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:52:32.789386 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:32.789406 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:32.789710 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:32.789998 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:32.791054 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:32.791060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:32.791072 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:32.791085 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:32.791134 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:32.791152 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:32.791291 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:32.791532 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 08:52:32.791758 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":369,"threads_started":1}
I20260808 08:52:32.795248 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28: No bootstrap required, opened a new log
I20260808 08:52:32.796166 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:32.803450 10988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:32.801081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59865 (local address 127.0.0.1:34271)
0808 08:52:32.801250 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:32.801255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:32.801746 (+ 491us) server_negotiation.cc:407] Connection header received
0808 08:52:32.801854 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:32.801859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:32.801904 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:32.802013 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:32.802803 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:32.802809 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:32.802813 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:32.802829 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:32.802868 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:32.802884 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:32.803027 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:32.803106 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:52:32.803180 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:52:32.804762 10985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260808 08:52:32.805071 10985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:32.805145 10985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33cd8da7c51f45209e842c740acb1f28, State: Initialized, Role: FOLLOWER
I20260808 08:52:32.805691 10985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260808 08:52:32.805886 10985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:32.805984 10985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:32.806100 10985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:32.808658 10985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260808 08:52:32.809247 10985 leader_election.cc:302] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33cd8da7c51f45209e842c740acb1f28; no voters:
I20260808 08:52:32.809935 10985 leader_election.cc:288] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:32.809993 11002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:32.811898 10985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:32.817262 11002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [term 1 LEADER]: Becoming Leader. State: Replica: 33cd8da7c51f45209e842c740acb1f28, State: Running, Role: LEADER
I20260808 08:52:32.817780 11002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } }
I20260808 08:52:32.821081 11005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33cd8da7c51f45209e842c740acb1f28. Latest consensus state: current_term: 1 leader_uuid: "33cd8da7c51f45209e842c740acb1f28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } } }
I20260808 08:52:32.821240 11004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33cd8da7c51f45209e842c740acb1f28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33cd8da7c51f45209e842c740acb1f28" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34271 } } }
I20260808 08:52:32.821623 11005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:32.821702 11004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:32.825812 11027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:32.830202 11027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:32.838163 11027 catalog_manager.cc:1347] Generated new cluster ID: 017bd116e68a45da99a8ccd9846cdb31
I20260808 08:52:32.838276 11027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:32.862607 11027 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:32.863049 11027 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:32.874495 11027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33cd8da7c51f45209e842c740acb1f28: Generated new TSK 0
I20260808 08:52:32.875384 11027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:32.895037 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10875
W20260808 08:52:32.895953 10976 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33483
W20260808 08:52:32.896648 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 10875: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:32.896790 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 10875
2026-08-08T08:52:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2140 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:33 dist-test-slave-7vjv krb5kdc[11036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:33 dist-test-slave-7vjv krb5kdc[11036](info): set up 2 sockets
Aug 08 08:52:33 dist-test-slave-7vjv krb5kdc[11036](info): commencing operation
krb5kdc: starting...
W20260808 08:52:34.208812 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:34 dist-test-slave-7vjv krb5kdc[11036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:34.507141 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46151
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:34.842841 11064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:34.843106 11064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:34.843281 11064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:34.849977 11064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:34.850108 11064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:34.850224 11064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:34.850344 11064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:34.850441 11064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:34.859300 11064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:34.860561 11064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:34.861878 11064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:34.873605 11070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:34.873668 11071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:34.873795 11074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:34.874293 11064 server_base.cc:1034] running on GCE node
I20260808 08:52:34.875167 11064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:34.876573 11064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:34.877831 11064 hybrid_clock.cc:648] HybridClock initialized: now 1786179154877762 us; error 32 us; skew 500 ppm
I20260808 08:52:34.878191 11064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:34 dist-test-slave-7vjv krb5kdc[11036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179154, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:34.884617 11064 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:34.886081 11064 webserver.cc:460] Webserver started at http://127.0.0.1:46325/ using document root <none> and password file <none>
I20260808 08:52:34.886732 11064 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:34.886840 11064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:34.887112 11064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:34.890074 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "436ae8b4636248308e7e2b273e851bbe"
format_stamp: "Formatted at 2026-08-08 08:52:34 on dist-test-slave-7vjv"
server_key: "08eb17b01c348d88b14fb9ad26bc18d2"
server_key_iv: "66ffaccfebe29962d303ba4bd2b6ee60"
server_key_version: "encryptionkey@0"
I20260808 08:52:34.890815 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "436ae8b4636248308e7e2b273e851bbe"
format_stamp: "Formatted at 2026-08-08 08:52:34 on dist-test-slave-7vjv"
server_key: "08eb17b01c348d88b14fb9ad26bc18d2"
server_key_iv: "66ffaccfebe29962d303ba4bd2b6ee60"
server_key_version: "encryptionkey@0"
I20260808 08:52:34.895882 11064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:52:34.900264 11085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:34.901506 11064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:34.901655 11064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "436ae8b4636248308e7e2b273e851bbe"
format_stamp: "Formatted at 2026-08-08 08:52:34 on dist-test-slave-7vjv"
server_key: "08eb17b01c348d88b14fb9ad26bc18d2"
server_key_iv: "66ffaccfebe29962d303ba4bd2b6ee60"
server_key_version: "encryptionkey@0"
I20260808 08:52:34.901816 11064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:34.924531 11064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:34.928192 11064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:34.928407 11064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:34.947393 11064 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46151
I20260808 08:52:34.947464 11163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46151 every 8 connection(s)
I20260808 08:52:34.948774 11064 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:34.952579 11165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:34.955580 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11064
I20260808 08:52:34.955785 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:34.956265 8789 external_mini_cluster.cc:1428] Setting key 22c13d9a361ea7a29b6593870c9632f8
I20260808 08:52:34.964016 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe: Bootstrap starting.
I20260808 08:52:34.966883 11165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:34.968051 11165 log.cc:824] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:52:34 dist-test-slave-7vjv krb5kdc[11036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:52:34.970777 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe: No bootstrap required, opened a new log
I20260808 08:52:34.978370 11171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:34.958246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:42175 (local address 127.0.0.1:46151)
0808 08:52:34.959003 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:34.959015 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:34.959056 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:52:34.960793 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:34.960814 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:34.961204 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:34.961595 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:34.963095 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:34.964462 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:34.965693 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:34.966311 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:34.966526 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:34.970992 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:34.971000 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:34.971014 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:34.971046 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:34.974158 (+ 3112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:34.975003 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:34.975009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:34.975015 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:34.975177 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:34.975691 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:34.975695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:34.975697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:34.976231 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:34.976604 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:34.977059 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 08:52:34.977434 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":324,"threads_started":1}
I20260808 08:52:34.979089 11165 raft_consensus.cc:348] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } }
I20260808 08:52:34.979502 11165 raft_consensus.cc:374] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:34.979636 11165 raft_consensus.cc:729] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436ae8b4636248308e7e2b273e851bbe, State: Initialized, Role: FOLLOWER
I20260808 08:52:34.980300 11165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } }
I20260808 08:52:34.980551 11165 raft_consensus.cc:388] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:34.980705 11165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:34.980898 11165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:34.982620 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:34.983825 11165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } }
I20260808 08:52:34.984428 11165 leader_election.cc:302] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 436ae8b4636248308e7e2b273e851bbe; no voters:
I20260808 08:52:34.985062 11165 leader_election.cc:288] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:34.985173 11173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:34.987402 11165 sys_catalog.cc:564] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:34.991259 11173 raft_consensus.cc:686] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [term 1 LEADER]: Becoming Leader. State: Replica: 436ae8b4636248308e7e2b273e851bbe, State: Running, Role: LEADER
I20260808 08:52:34.992206 11173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } }
I20260808 08:52:34.995251 11175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 436ae8b4636248308e7e2b273e851bbe. Latest consensus state: current_term: 1 leader_uuid: "436ae8b4636248308e7e2b273e851bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } } }
I20260808 08:52:34.995221 11174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "436ae8b4636248308e7e2b273e851bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436ae8b4636248308e7e2b273e851bbe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46151 } } }
I20260808 08:52:34.995694 11175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:34.995733 11174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:35.009245 11187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:35.015393 11187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:35.015769 11171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:34.993069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:45249 (local address 127.0.0.1:46151)
0808 08:52:34.993259 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:34.993264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:34.993284 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:52:34.993330 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:34.993342 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:34.993440 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:34.993575 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:34.998152 (+ 4577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:34.999725 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:35.002112 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:35.003057 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:35.003175 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:35.007529 (+ 4354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:35.007538 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:35.007545 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:35.007592 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:35.011734 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:35.012636 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:35.012646 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:35.012672 (+ 26us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:35.012846 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:35.013408 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:35.013413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:35.013416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:35.013892 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:35.014215 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:35.014955 (+ 740us) server_negotiation.cc:299] Negotiation successful
0808 08:52:35.015287 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:52:35.025614 11187 catalog_manager.cc:1347] Generated new cluster ID: 17f977bbeda144b1974ebb32ecfebe84
I20260808 08:52:35.025738 11187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:35.036170 11187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:35.037396 11187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:35.043838 11187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 436ae8b4636248308e7e2b273e851bbe: Generated new TSK 0
I20260808 08:52:35.044620 11187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:35.053828 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11064
I20260808 08:52:35.054971 11159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:35.140810 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11064
W20260808 08:52:35.164892 11033 connection.cc:535] client connection to 127.0.0.1:46151 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46151): Connection reset by peer (error 104)
2026-08-08T08:52:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2243 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:35 dist-test-slave-7vjv krb5kdc[11212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:35 dist-test-slave-7vjv krb5kdc[11212](info): set up 2 sockets
Aug 08 08:52:35 dist-test-slave-7vjv krb5kdc[11212](info): commencing operation
krb5kdc: starting...
W20260808 08:52:36.440282 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:36 dist-test-slave-7vjv krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:36.723800 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39057
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:37.047501 11236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:37.047837 11236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:37.048046 11236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:37.054943 11236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:37.055088 11236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:37.055202 11236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:37.055325 11236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:37.055411 11236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:37.064870 11236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:37.066103 11236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:37.067443 11236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:37.079505 11247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:37.079448 11249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:37.079698 11246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:37.080914 11236 server_base.cc:1034] running on GCE node
I20260808 08:52:37.081633 11236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:37.082993 11236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:37.084208 11236 hybrid_clock.cc:648] HybridClock initialized: now 1786179157084163 us; error 24 us; skew 500 ppm
I20260808 08:52:37.084581 11236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:37 dist-test-slave-7vjv krb5kdc[11212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179157, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:37.087797 11236 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:37.089208 11236 webserver.cc:460] Webserver started at http://127.0.0.1:46463/ using document root <none> and password file <none>
I20260808 08:52:37.089824 11236 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:37.089932 11236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:37.090171 11236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:37.093004 11236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1"
format_stamp: "Formatted at 2026-08-08 08:52:37 on dist-test-slave-7vjv"
server_key: "3c86c063e0a7e1e6eb3c576caa52cc35"
server_key_iv: "f0dd4170a4320ddce6bbbe057448ec73"
server_key_version: "encryptionkey@0"
I20260808 08:52:37.093662 11236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1"
format_stamp: "Formatted at 2026-08-08 08:52:37 on dist-test-slave-7vjv"
server_key: "3c86c063e0a7e1e6eb3c576caa52cc35"
server_key_iv: "f0dd4170a4320ddce6bbbe057448ec73"
server_key_version: "encryptionkey@0"
I20260808 08:52:37.098584 11236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:52:37.101972 11261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:37.103317 11236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:52:37.103461 11236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1"
format_stamp: "Formatted at 2026-08-08 08:52:37 on dist-test-slave-7vjv"
server_key: "3c86c063e0a7e1e6eb3c576caa52cc35"
server_key_iv: "f0dd4170a4320ddce6bbbe057448ec73"
server_key_version: "encryptionkey@0"
I20260808 08:52:37.103626 11236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:37.116335 11236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:37.120261 11236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:37.120484 11236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:37.139438 11236 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39057
I20260808 08:52:37.139523 11359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39057 every 8 connection(s)
I20260808 08:52:37.140903 11236 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:37.144704 11360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:37.148573 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11236
I20260808 08:52:37.148749 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:37.149228 8789 external_mini_cluster.cc:1428] Setting key 16acea49ca8dcbccc1167d468078e61f
I20260808 08:52:37.156267 11360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1: Bootstrap starting.
I20260808 08:52:37.159591 11360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:37.160952 11360 log.cc:824] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:37.164266 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:37.150986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:41165 (local address 127.0.0.1:39057)
0808 08:52:37.151720 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:37.151735 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:37.151785 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:52:37.154592 (+ 2807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:37.154617 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:37.155083 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:37.155502 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:37.155965 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:37.157784 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:37.159037 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:37.160189 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:37.160369 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:37.161671 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:37.161683 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:37.161703 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:37.162277 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:37.162362 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:37.162402 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:37.162547 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:37.162829 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 08:52:37.163001 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":286,"threads_started":1}
I20260808 08:52:37.164408 11360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1: No bootstrap required, opened a new log
I20260808 08:52:37.168408 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:37.172257 11360 raft_consensus.cc:348] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260808 08:52:37.172609 11360 raft_consensus.cc:374] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:37.172772 11360 raft_consensus.cc:729] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b944e9fddb8b4e89bce5fa65f2d11ca1, State: Initialized, Role: FOLLOWER
I20260808 08:52:37.173422 11360 consensus_queue.cc:260] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260808 08:52:37.173696 11360 raft_consensus.cc:388] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:37.173844 11360 raft_consensus.cc:482] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:37.174018 11360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:37.176935 11360 raft_consensus.cc:504] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260808 08:52:37.177466 11360 leader_election.cc:302] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b944e9fddb8b4e89bce5fa65f2d11ca1; no voters:
I20260808 08:52:37.178228 11360 leader_election.cc:288] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:37.178313 11376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:37.179793 11376 raft_consensus.cc:686] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [term 1 LEADER]: Becoming Leader. State: Replica: b944e9fddb8b4e89bce5fa65f2d11ca1, State: Running, Role: LEADER
I20260808 08:52:37.180459 11376 consensus_queue.cc:237] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260808 08:52:37.180616 11360 sys_catalog.cc:564] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:37.180835 11363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:37.173020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:51751 (local address 127.0.0.1:39057)
0808 08:52:37.173196 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:37.173201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:37.173713 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:52:37.173895 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:37.173900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:37.173991 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:37.174130 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:37.174833 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:37.175632 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:37.177517 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:37.178135 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:37.178312 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:37.179928 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:37.179936 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:37.179941 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:37.179963 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:37.180001 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:37.180019 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:37.180177 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:37.180399 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 08:52:37.180451 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:52:37.184285 11379 sys_catalog.cc:455] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b944e9fddb8b4e89bce5fa65f2d11ca1. Latest consensus state: current_term: 1 leader_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } } }
I20260808 08:52:37.184954 11379 sys_catalog.cc:458] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:37.184307 11377 sys_catalog.cc:455] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b944e9fddb8b4e89bce5fa65f2d11ca1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } } }
I20260808 08:52:37.186026 11377 sys_catalog.cc:458] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:37.191941 11391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:37.196378 11391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:37.204488 11391 catalog_manager.cc:1347] Generated new cluster ID: 3d67eeb98e564db0a96a28eea75c35d6
I20260808 08:52:37.204586 11391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:37.216852 11391 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:37.217958 11391 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:37.230611 11391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b944e9fddb8b4e89bce5fa65f2d11ca1: Generated new TSK 0
I20260808 08:52:37.231448 11391 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:37.236961 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11236
W20260808 08:52:37.238312 11352 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.91:41165
W20260808 08:52:37.239163 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11236: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:37.239310 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11236
W20260808 08:52:37.270728 11210 connection.cc:535] client connection to 127.0.0.1:39057 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39057): Connection reset by peer (error 104)
2026-08-08T08:52:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2105 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:37 dist-test-slave-7vjv krb5kdc[11414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:37 dist-test-slave-7vjv krb5kdc[11414](info): set up 2 sockets
Aug 08 08:52:37 dist-test-slave-7vjv krb5kdc[11414](info): commencing operation
krb5kdc: starting...
W20260808 08:52:38.583438 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.008s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:38 dist-test-slave-7vjv krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:38.862843 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33669
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:39.181967 11434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:39.182260 11434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:39.182418 11434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:39.189121 11434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:39.189262 11434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:39.189370 11434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:39.189477 11434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:39.189563 11434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:39.198779 11434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:39.199975 11434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:39.201253 11434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:39.212697 11451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:39.212740 11452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:39.212740 11454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:39.213613 11434 server_base.cc:1034] running on GCE node
I20260808 08:52:39.214334 11434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:39.215515 11434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:39.216693 11434 hybrid_clock.cc:648] HybridClock initialized: now 1786179159216650 us; error 44 us; skew 500 ppm
I20260808 08:52:39.217048 11434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:39 dist-test-slave-7vjv krb5kdc[11414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179159, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:39.219942 11434 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:39.221377 11434 webserver.cc:460] Webserver started at http://127.0.0.1:45093/ using document root <none> and password file <none>
I20260808 08:52:39.221982 11434 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:39.222078 11434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:39.222311 11434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:39.225090 11434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "b1a7d93f709f4531a48038d1ba72bd47"
format_stamp: "Formatted at 2026-08-08 08:52:39 on dist-test-slave-7vjv"
server_key: "ef3ed5b53f4078cb5503d510d755c8a2"
server_key_iv: "f33774e2a4c01b60c352699add877a4e"
server_key_version: "encryptionkey@0"
I20260808 08:52:39.225874 11434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "b1a7d93f709f4531a48038d1ba72bd47"
format_stamp: "Formatted at 2026-08-08 08:52:39 on dist-test-slave-7vjv"
server_key: "ef3ed5b53f4078cb5503d510d755c8a2"
server_key_iv: "f33774e2a4c01b60c352699add877a4e"
server_key_version: "encryptionkey@0"
I20260808 08:52:39.230687 11434 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 08:52:39.234175 11467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:39.235430 11434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:52:39.235622 11434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "b1a7d93f709f4531a48038d1ba72bd47"
format_stamp: "Formatted at 2026-08-08 08:52:39 on dist-test-slave-7vjv"
server_key: "ef3ed5b53f4078cb5503d510d755c8a2"
server_key_iv: "f33774e2a4c01b60c352699add877a4e"
server_key_version: "encryptionkey@0"
I20260808 08:52:39.235833 11434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:39.241335 11434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:39.245157 11434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:39.245437 11434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:39.263602 11434 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33669
I20260808 08:52:39.263679 11544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33669 every 8 connection(s)
I20260808 08:52:39.264870 11434 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:39.266371 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11434
I20260808 08:52:39.266580 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:39.267207 8789 external_mini_cluster.cc:1428] Setting key c514ff9f156a52e17f29ff3afd7fe288
I20260808 08:52:39.269902 11545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:39.274963 11552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:39.269105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:59595 (local address 127.0.0.1:33669)
0808 08:52:39.269933 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:39.269979 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:39.270035 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:52:39.271615 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:39.271633 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:39.271933 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:39.272437 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:39.273456 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:39.273462 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:39.273474 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:39.273490 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:39.273573 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:39.273590 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:39.273858 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:39.274018 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:52:39.274171 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":358,"threads_started":1}
I20260808 08:52:39.278472 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:39.281895 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47: Bootstrap starting.
I20260808 08:52:39.285499 11552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:39.282919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:51757 (local address 127.0.0.1:33669)
0808 08:52:39.283138 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:39.283145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:39.283498 (+ 353us) server_negotiation.cc:407] Connection header received
0808 08:52:39.283688 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:39.283692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:39.283732 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:39.283870 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:39.284844 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:39.284854 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:39.284857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:39.284871 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:39.284904 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:39.284918 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:39.285040 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:39.285198 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 08:52:39.285253 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 08:52:39.285689 11545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:39.286934 11545 log.cc:824] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:39.289945 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47: No bootstrap required, opened a new log
I20260808 08:52:39.297673 11545 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260808 08:52:39.298020 11545 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:39.298116 11545 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a7d93f709f4531a48038d1ba72bd47, State: Initialized, Role: FOLLOWER
I20260808 08:52:39.298671 11545 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260808 08:52:39.298907 11545 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:39.299077 11545 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:39.299247 11545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:39.301560 11545 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260808 08:52:39.302062 11545 leader_election.cc:302] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1a7d93f709f4531a48038d1ba72bd47; no voters:
I20260808 08:52:39.302640 11545 leader_election.cc:288] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:39.302704 11560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:39.303855 11560 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [term 1 LEADER]: Becoming Leader. State: Replica: b1a7d93f709f4531a48038d1ba72bd47, State: Running, Role: LEADER
I20260808 08:52:39.304378 11560 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260808 08:52:39.304762 11545 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:39.307085 11561 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1a7d93f709f4531a48038d1ba72bd47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } } }
I20260808 08:52:39.307580 11561 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:39.307475 11563 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a7d93f709f4531a48038d1ba72bd47. Latest consensus state: current_term: 1 leader_uuid: "b1a7d93f709f4531a48038d1ba72bd47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a7d93f709f4531a48038d1ba72bd47" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } } }
I20260808 08:52:39.307839 11563 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:39.309430 11576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:39.314713 11576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:39.323534 11576 catalog_manager.cc:1347] Generated new cluster ID: 682e335de1754e2da627092b08131634
I20260808 08:52:39.323674 11576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:39.339135 11576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:39.339666 11576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:39.347005 11576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1a7d93f709f4531a48038d1ba72bd47: Generated new TSK 0
I20260808 08:52:39.347668 11576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:39.357234 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11434
W20260808 08:52:39.358249 11539 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.91:59595
W20260808 08:52:39.358966 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11434: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:39.359112 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11434
2026-08-08T08:52:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2120 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:39 dist-test-slave-7vjv krb5kdc[11599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:39 dist-test-slave-7vjv krb5kdc[11599](info): set up 2 sockets
Aug 08 08:52:39 dist-test-slave-7vjv krb5kdc[11599](info): commencing operation
krb5kdc: starting...
W20260808 08:52:40.702711 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:40 dist-test-slave-7vjv krb5kdc[11599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:40.986979 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38747
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:41.311837 11628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:41.312148 11628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:41.312322 11628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:41.318966 11628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:41.319058 11628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:41.319201 11628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:41.319306 11628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:41.319394 11628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:41.329272 11628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38747
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:41.330456 11628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:41.332330 11628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:41.344551 11633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:41.344543 11634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:41.344798 11638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:41.345161 11628 server_base.cc:1034] running on GCE node
I20260808 08:52:41.345901 11628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:41.347170 11628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:41.348390 11628 hybrid_clock.cc:648] HybridClock initialized: now 1786179161348315 us; error 50 us; skew 500 ppm
I20260808 08:52:41.348732 11628 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:41 dist-test-slave-7vjv krb5kdc[11599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179161, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:41.356820 11628 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:41.358230 11628 webserver.cc:460] Webserver started at http://127.0.0.1:35845/ using document root <none> and password file <none>
I20260808 08:52:41.358872 11628 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:41.358999 11628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:41.359315 11628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:41.362397 11628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "369f6e4a3d03426db68d2d9ba107d511"
format_stamp: "Formatted at 2026-08-08 08:52:41 on dist-test-slave-7vjv"
server_key: "cfae999d7271f7344c3d9c6e20252f77"
server_key_iv: "5cf305f92961726f92337bde8057857e"
server_key_version: "encryptionkey@0"
I20260808 08:52:41.363159 11628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "369f6e4a3d03426db68d2d9ba107d511"
format_stamp: "Formatted at 2026-08-08 08:52:41 on dist-test-slave-7vjv"
server_key: "cfae999d7271f7344c3d9c6e20252f77"
server_key_iv: "5cf305f92961726f92337bde8057857e"
server_key_version: "encryptionkey@0"
I20260808 08:52:41.368225 11628 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:52:41.371629 11653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:41.372953 11628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:41.373131 11628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "369f6e4a3d03426db68d2d9ba107d511"
format_stamp: "Formatted at 2026-08-08 08:52:41 on dist-test-slave-7vjv"
server_key: "cfae999d7271f7344c3d9c6e20252f77"
server_key_iv: "5cf305f92961726f92337bde8057857e"
server_key_version: "encryptionkey@0"
I20260808 08:52:41.373319 11628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:41.393483 11628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:41.397275 11628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:41.397581 11628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:41.416332 11628 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38747
I20260808 08:52:41.416373 11735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38747 every 8 connection(s)
I20260808 08:52:41.417626 11628 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:41.421193 11737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:41.422330 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11628
I20260808 08:52:41.422536 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:41.422976 8789 external_mini_cluster.cc:1428] Setting key e584b3b7585bdd1e6617b6440a0f055d
I20260808 08:52:41.434587 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511: Bootstrap starting.
Aug 08 08:52:41 dist-test-slave-7vjv krb5kdc[11599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:52:41.438154 11737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:41.439366 11737 log.cc:824] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:41.442251 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511: No bootstrap required, opened a new log
I20260808 08:52:41.445632 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:41.424795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:53065 (local address 127.0.0.1:38747)
0808 08:52:41.425568 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:41.425579 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:41.425634 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:52:41.427192 (+ 1558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:41.427216 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:41.427561 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:41.427853 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:41.429612 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:41.430767 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:41.432680 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:41.433320 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:41.433449 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:41.438330 (+ 4881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:41.438343 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:41.438356 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:41.438394 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:41.441756 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:41.442560 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:41.442566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:41.442571 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:41.442753 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:41.443260 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:41.443264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:41.443266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:41.443716 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:41.444057 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:41.444572 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 08:52:41.444820 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":352,"threads_started":1}
I20260808 08:52:41.449412 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:41.449962 11737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260808 08:52:41.450286 11737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:41.450392 11737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369f6e4a3d03426db68d2d9ba107d511, State: Initialized, Role: FOLLOWER
I20260808 08:52:41.450896 11737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260808 08:52:41.451138 11737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:41.451270 11737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:41.451427 11737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:41.453663 11737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260808 08:52:41.454267 11737 leader_election.cc:302] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 369f6e4a3d03426db68d2d9ba107d511; no voters:
I20260808 08:52:41.455011 11737 leader_election.cc:288] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:41.455083 11756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:41.456248 11756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [term 1 LEADER]: Becoming Leader. State: Replica: 369f6e4a3d03426db68d2d9ba107d511, State: Running, Role: LEADER
I20260808 08:52:41.456856 11756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } }
I20260808 08:52:41.457237 11737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:41.459784 11757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "369f6e4a3d03426db68d2d9ba107d511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } } }
I20260808 08:52:41.460296 11757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:41.462598 11758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 369f6e4a3d03426db68d2d9ba107d511. Latest consensus state: current_term: 1 leader_uuid: "369f6e4a3d03426db68d2d9ba107d511" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "369f6e4a3d03426db68d2d9ba107d511" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38747 } } }
I20260808 08:52:41.463047 11758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:41.463925 11763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:41.469969 11763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:41.473202 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:41.454006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:57227 (local address 127.0.0.1:38747)
0808 08:52:41.454166 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:41.454170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:41.455415 (+ 1245us) server_negotiation.cc:407] Connection header received
0808 08:52:41.455672 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:41.455678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:41.455750 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:41.455802 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:41.457650 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:41.458806 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:41.460761 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:41.461678 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:41.461824 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:41.465234 (+ 3410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:41.465240 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:41.465245 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:41.465280 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:41.469150 (+ 3870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:41.470102 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:41.470108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:41.470112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:41.470262 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:41.470846 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:41.470852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:41.470866 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:41.471262 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:41.471556 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:41.472697 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0808 08:52:41.472848 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:52:41.480377 11763 catalog_manager.cc:1347] Generated new cluster ID: b59662abeec141faae24cc93ad7f0fc6
I20260808 08:52:41.480497 11763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:41.505484 11763 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:41.506688 11763 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:41.514822 11763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 369f6e4a3d03426db68d2d9ba107d511: Generated new TSK 0
I20260808 08:52:41.515681 11763 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:41.531308 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11628
I20260808 08:52:41.532488 11726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:41.621763 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11628
W20260808 08:52:41.647780 11596 connection.cc:535] client connection to 127.0.0.1:38747 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38747): Connection reset by peer (error 104)
2026-08-08T08:52:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2257 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:41 dist-test-slave-7vjv krb5kdc[11786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:41 dist-test-slave-7vjv krb5kdc[11786](info): set up 2 sockets
Aug 08 08:52:41 dist-test-slave-7vjv krb5kdc[11786](info): commencing operation
krb5kdc: starting...
W20260808 08:52:42.935406 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.006s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:43 dist-test-slave-7vjv krb5kdc[11786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:43.220636 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:43.549269 11805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:43.549618 11805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:43.549818 11805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:43.556962 11805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:43.557122 11805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:43.557240 11805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:43.557385 11805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:43.557476 11805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:43.567349 11805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:43.568693 11805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:43.570052 11805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:43.582968 11819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:43.583130 11813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:43.583130 11815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:43.584267 11805 server_base.cc:1034] running on GCE node
I20260808 08:52:43.585047 11805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:43.586416 11805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:43.587678 11805 hybrid_clock.cc:648] HybridClock initialized: now 1786179163587624 us; error 34 us; skew 500 ppm
I20260808 08:52:43.588050 11805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:43 dist-test-slave-7vjv krb5kdc[11786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179163, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:43.591265 11805 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:43.593077 11805 webserver.cc:460] Webserver started at http://127.0.0.1:37407/ using document root <none> and password file <none>
I20260808 08:52:43.593770 11805 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:43.593946 11805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:43.594314 11805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:43.597446 11805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "43216bd44b4a462d8442c0e53b82b076"
format_stamp: "Formatted at 2026-08-08 08:52:43 on dist-test-slave-7vjv"
server_key: "c192390dfea34a69824adf2946518ba2"
server_key_iv: "38b6133813c0a7e4c96e80ebe94ea3f6"
server_key_version: "encryptionkey@0"
I20260808 08:52:43.598284 11805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "43216bd44b4a462d8442c0e53b82b076"
format_stamp: "Formatted at 2026-08-08 08:52:43 on dist-test-slave-7vjv"
server_key: "c192390dfea34a69824adf2946518ba2"
server_key_iv: "38b6133813c0a7e4c96e80ebe94ea3f6"
server_key_version: "encryptionkey@0"
I20260808 08:52:43.603839 11805 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 08:52:43.607508 11828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:43.608924 11805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:43.609131 11805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "43216bd44b4a462d8442c0e53b82b076"
format_stamp: "Formatted at 2026-08-08 08:52:43 on dist-test-slave-7vjv"
server_key: "c192390dfea34a69824adf2946518ba2"
server_key_iv: "38b6133813c0a7e4c96e80ebe94ea3f6"
server_key_version: "encryptionkey@0"
I20260808 08:52:43.609338 11805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:43.626780 11805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:43.630930 11805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:43.631243 11805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:43.652311 11805 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38667
I20260808 08:52:43.652333 11908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38667 every 8 connection(s)
I20260808 08:52:43.653704 11805 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:43.657145 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11805
I20260808 08:52:43.657367 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:43.657657 11909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:43.657930 8789 external_mini_cluster.cc:1428] Setting key ebb81327d4896043a860f5036c7ba188
I20260808 08:52:43.672312 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:43.659731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:44073 (local address 127.0.0.1:38667)
0808 08:52:43.660593 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:43.660604 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:43.660650 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:52:43.662745 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:43.662766 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:43.663179 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:43.663512 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:43.664276 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:43.665662 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:43.667879 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:43.668598 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:43.668733 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:43.670047 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:43.670057 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:43.670069 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:43.670594 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:43.670669 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:43.670693 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:43.670811 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:43.671186 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 08:52:43.671357 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":420,"threads_started":1}
I20260808 08:52:43.672756 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076: Bootstrap starting.
I20260808 08:52:43.676186 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:43.676215 11909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:43.677228 11909 log.cc:824] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:43.680063 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076: No bootstrap required, opened a new log
I20260808 08:52:43.688140 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:43.681341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:56601 (local address 127.0.0.1:38667)
0808 08:52:43.681529 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:43.681540 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:43.681952 (+ 412us) server_negotiation.cc:407] Connection header received
0808 08:52:43.682102 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:43.682112 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:43.682182 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:43.682294 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:43.682839 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:43.684005 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:43.685428 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:43.686112 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:43.686228 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:43.687322 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:43.687327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:43.687333 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:43.687350 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:43.687416 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:43.687441 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:43.687549 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:43.687741 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 08:52:43.687787 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:52:43.689110 11909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } }
I20260808 08:52:43.689468 11909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:43.689560 11909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43216bd44b4a462d8442c0e53b82b076, State: Initialized, Role: FOLLOWER
I20260808 08:52:43.690156 11909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } }
I20260808 08:52:43.690359 11909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:43.690526 11909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:43.690699 11909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:43.692906 11909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } }
I20260808 08:52:43.693367 11909 leader_election.cc:302] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43216bd44b4a462d8442c0e53b82b076; no voters:
I20260808 08:52:43.693928 11909 leader_election.cc:288] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:43.694063 11922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:43.694793 11922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [term 1 LEADER]: Becoming Leader. State: Replica: 43216bd44b4a462d8442c0e53b82b076, State: Running, Role: LEADER
I20260808 08:52:43.695354 11922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } }
I20260808 08:52:43.696041 11909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:43.698874 11929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43216bd44b4a462d8442c0e53b82b076. Latest consensus state: current_term: 1 leader_uuid: "43216bd44b4a462d8442c0e53b82b076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } } }
I20260808 08:52:43.698887 11923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43216bd44b4a462d8442c0e53b82b076" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43216bd44b4a462d8442c0e53b82b076" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38667 } } }
I20260808 08:52:43.699452 11929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:43.699450 11923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:43.704797 11941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:43.709488 11941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:43.718277 11941 catalog_manager.cc:1347] Generated new cluster ID: dd451f3280e7402387905005bdac6dcb
I20260808 08:52:43.718371 11941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:43.747262 11941 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:43.748701 11941 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:43.758769 11941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43216bd44b4a462d8442c0e53b82b076: Generated new TSK 0
I20260808 08:52:43.759573 11941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:43.771819 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11805
W20260808 08:52:43.772943 11900 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.91:44073
W20260808 08:52:43.773734 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11805: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:43.773927 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11805
W20260808 08:52:43.800959 11783 connection.cc:535] client connection to 127.0.0.1:38667 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38667): Connection reset by peer (error 104)
2026-08-08T08:52:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2153 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:43 dist-test-slave-7vjv krb5kdc[11960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:43 dist-test-slave-7vjv krb5kdc[11960](info): set up 2 sockets
Aug 08 08:52:43 dist-test-slave-7vjv krb5kdc[11960](info): commencing operation
krb5kdc: starting...
W20260808 08:52:45.094980 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.002s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:45 dist-test-slave-7vjv krb5kdc[11960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:52:45.387969 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:45.723337 11984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:45.723611 11984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:45.723829 11984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:45.731031 11984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:45.731137 11984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:45.731259 11984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:45.731375 11984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:45.731451 11984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:45.741194 11984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:45.742425 11984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:45.743798 11984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:45.756326 11992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:45.756490 11990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:45.756567 11994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:45.757640 11984 server_base.cc:1034] running on GCE node
I20260808 08:52:45.758385 11984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:45.759765 11984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:45.761001 11984 hybrid_clock.cc:648] HybridClock initialized: now 1786179165760975 us; error 73 us; skew 500 ppm
I20260808 08:52:45.761353 11984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:45 dist-test-slave-7vjv krb5kdc[11960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:45.764565 11984 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:52:45.765929 11984 webserver.cc:460] Webserver started at http://127.0.0.1:35159/ using document root <none> and password file <none>
I20260808 08:52:45.766587 11984 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:45.766734 11984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:45.767033 11984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:45.769917 11984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "f05bef67cedd4e959879983107eeeb9c"
format_stamp: "Formatted at 2026-08-08 08:52:45 on dist-test-slave-7vjv"
server_key: "711f9e9fd327af55f6b74e446e1aa8e9"
server_key_iv: "d8b6c5369a9f635e011f264f283cefb3"
server_key_version: "encryptionkey@0"
I20260808 08:52:45.770699 11984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "f05bef67cedd4e959879983107eeeb9c"
format_stamp: "Formatted at 2026-08-08 08:52:45 on dist-test-slave-7vjv"
server_key: "711f9e9fd327af55f6b74e446e1aa8e9"
server_key_iv: "d8b6c5369a9f635e011f264f283cefb3"
server_key_version: "encryptionkey@0"
I20260808 08:52:45.775594 11984 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:52:45.778971 12009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:45.780365 11984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:45.780575 11984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "f05bef67cedd4e959879983107eeeb9c"
format_stamp: "Formatted at 2026-08-08 08:52:45 on dist-test-slave-7vjv"
server_key: "711f9e9fd327af55f6b74e446e1aa8e9"
server_key_iv: "d8b6c5369a9f635e011f264f283cefb3"
server_key_version: "encryptionkey@0"
I20260808 08:52:45.780764 11984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:45.786262 11984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:45.790069 11984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:45.790349 11984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:45.809351 11984 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39265
I20260808 08:52:45.809432 12085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39265 every 8 connection(s)
I20260808 08:52:45.810592 11984 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:45.814088 12091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:45.815794 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 11984
I20260808 08:52:45.815999 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:45.816571 8789 external_mini_cluster.cc:1428] Setting key 5b35b4b5f90d857fdc9d646e443082c3
I20260808 08:52:45.823794 12095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:45.818192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:55737 (local address 127.0.0.1:39265)
0808 08:52:45.818905 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:45.818933 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:45.819053 (+ 120us) server_negotiation.cc:407] Connection header received
0808 08:52:45.820632 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:45.820653 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:45.820962 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:45.821276 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:45.822329 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:45.822336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:45.822346 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:45.822359 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:45.822428 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:45.822447 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:45.822601 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:45.822749 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 08:52:45.822940 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":329,"threads_started":1}
I20260808 08:52:45.827666 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:45.828120 12091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c: Bootstrap starting.
I20260808 08:52:45.831856 12091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:45.833261 12091 log.cc:824] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:45.835469 12095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:45.833022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:55947 (local address 127.0.0.1:39265)
0808 08:52:45.833198 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:45.833204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:45.833447 (+ 243us) server_negotiation.cc:407] Connection header received
0808 08:52:45.833602 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:45.833605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:45.833645 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:45.833715 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:45.834766 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:45.834770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:45.834773 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:45.834787 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:45.834822 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:45.834836 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:45.834933 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:45.835122 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 08:52:45.835166 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:52:45.836460 12091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c: No bootstrap required, opened a new log
I20260808 08:52:45.843251 12091 raft_consensus.cc:348] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260808 08:52:45.843591 12091 raft_consensus.cc:374] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:45.843708 12091 raft_consensus.cc:729] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05bef67cedd4e959879983107eeeb9c, State: Initialized, Role: FOLLOWER
I20260808 08:52:45.844269 12091 consensus_queue.cc:260] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260808 08:52:45.844519 12091 raft_consensus.cc:388] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:45.844676 12091 raft_consensus.cc:482] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:45.844827 12091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:45.847048 12091 raft_consensus.cc:504] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260808 08:52:45.847496 12091 leader_election.cc:302] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f05bef67cedd4e959879983107eeeb9c; no voters:
I20260808 08:52:45.848088 12091 leader_election.cc:288] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:45.848279 12104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:45.848917 12104 raft_consensus.cc:686] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [term 1 LEADER]: Becoming Leader. State: Replica: f05bef67cedd4e959879983107eeeb9c, State: Running, Role: LEADER
I20260808 08:52:45.849512 12104 consensus_queue.cc:237] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } }
I20260808 08:52:45.850342 12091 sys_catalog.cc:564] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:45.852622 12107 sys_catalog.cc:455] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f05bef67cedd4e959879983107eeeb9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260808 08:52:45.853083 12107 sys_catalog.cc:458] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:45.854962 12110 sys_catalog.cc:455] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f05bef67cedd4e959879983107eeeb9c. Latest consensus state: current_term: 1 leader_uuid: "f05bef67cedd4e959879983107eeeb9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f05bef67cedd4e959879983107eeeb9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39265 } } }
I20260808 08:52:45.855429 12110 sys_catalog.cc:458] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:45.856068 12119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:45.862102 12119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:45.869724 12119 catalog_manager.cc:1347] Generated new cluster ID: 7479d3547c31412aba8d50df8114cf85
I20260808 08:52:45.869827 12119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:45.887182 12119 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:45.887696 12119 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:45.903018 12119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f05bef67cedd4e959879983107eeeb9c: Generated new TSK 0
I20260808 08:52:45.904064 12119 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:45.914275 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11984
W20260808 08:52:45.915369 12079 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.91:55737
W20260808 08:52:45.916036 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 11984: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:45.916198 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 11984
2026-08-08T08:52:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2141 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:46 dist-test-slave-7vjv krb5kdc[12138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:46 dist-test-slave-7vjv krb5kdc[12138](info): set up 2 sockets
Aug 08 08:52:46 dist-test-slave-7vjv krb5kdc[12138](info): commencing operation
krb5kdc: starting...
W20260808 08:52:47.221274 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:47 dist-test-slave-7vjv krb5kdc[12138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:47.503082 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44587
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:35449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:44587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:47.830554 12160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:47.830811 12160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:47.831012 12160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:47.837935 12160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:47.838025 12160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:47.838122 12160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:47.838227 12160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:47.838310 12160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:47.847467 12160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:35449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:44587
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:47.848673 12160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:47.849907 12160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:47.861187 12173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:47.861348 12169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:47.861860 12168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:47.862505 12160 server_base.cc:1034] running on GCE node
I20260808 08:52:47.863336 12160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:47.865971 12160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:47.867241 12160 hybrid_clock.cc:648] HybridClock initialized: now 1786179167867187 us; error 47 us; skew 500 ppm
I20260808 08:52:47.867637 12160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:47 dist-test-slave-7vjv krb5kdc[12138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179167, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:47.874557 12160 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:47.875923 12160 webserver.cc:460] Webserver started at http://127.8.149.126:34599/ using document root <none> and password file <none>
I20260808 08:52:47.876603 12160 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:47.876711 12160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:47.876967 12160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:47.879828 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27"
format_stamp: "Formatted at 2026-08-08 08:52:47 on dist-test-slave-7vjv"
server_key: "17847b45f39599f998e9fe9e1ffa2673"
server_key_iv: "9032514c15de575b344907e59412b6a2"
server_key_version: "encryptionkey@0"
I20260808 08:52:47.880586 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27"
format_stamp: "Formatted at 2026-08-08 08:52:47 on dist-test-slave-7vjv"
server_key: "17847b45f39599f998e9fe9e1ffa2673"
server_key_iv: "9032514c15de575b344907e59412b6a2"
server_key_version: "encryptionkey@0"
I20260808 08:52:47.885887 12160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:52:47.888974 12184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:47.890148 12160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:52:47.890307 12160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27"
format_stamp: "Formatted at 2026-08-08 08:52:47 on dist-test-slave-7vjv"
server_key: "17847b45f39599f998e9fe9e1ffa2673"
server_key_iv: "9032514c15de575b344907e59412b6a2"
server_key_version: "encryptionkey@0"
I20260808 08:52:47.890473 12160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:47.905447 12160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:47.916816 12160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:47.917093 12160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:47.934845 12160 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:44587
I20260808 08:52:47.934937 12272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:44587 every 8 connection(s)
I20260808 08:52:47.936023 12160 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:47.938378 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12160
I20260808 08:52:47.938560 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:47.939131 8789 external_mini_cluster.cc:1428] Setting key 3dae516fd9bfb3d3b2c3d4b435d00c59
I20260808 08:52:47.940248 12273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:52:47 dist-test-slave-7vjv krb5kdc[12138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:47.953572 12273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27: Bootstrap starting.
I20260808 08:52:47.956691 12273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:47.957679 12273 log.cc:824] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:47.960486 12273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27: No bootstrap required, opened a new log
I20260808 08:52:47.960605 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:47.940803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45251 (local address 127.8.149.126:44587)
0808 08:52:47.941548 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:47.941558 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:47.941598 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:52:47.943131 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:47.943150 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:47.943495 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:47.943820 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:47.945690 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:47.946948 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:47.948677 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:47.949208 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:47.949320 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:47.953824 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:47.953830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:47.953840 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:47.953873 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:47.956582 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:47.957364 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:47.957370 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:47.957399 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:47.957555 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:47.958098 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:47.958101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:47.958103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:47.958632 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:47.958954 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:47.959397 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 08:52:47.959691 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":355,"threads_started":1}
I20260808 08:52:47.964216 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:47.968595 12273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } }
I20260808 08:52:47.969055 12273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:47.969151 12273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4868f6e8885d4e79bdf5bb6fc7a64f27, State: Initialized, Role: FOLLOWER
I20260808 08:52:47.969744 12273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } }
I20260808 08:52:47.969973 12273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:47.970119 12273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:47.970294 12273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:47.972443 12273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } }
I20260808 08:52:47.972935 12273 leader_election.cc:302] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4868f6e8885d4e79bdf5bb6fc7a64f27; no voters:
I20260808 08:52:47.973604 12273 leader_election.cc:288] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:47.973709 12291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:47.975234 12291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [term 1 LEADER]: Becoming Leader. State: Replica: 4868f6e8885d4e79bdf5bb6fc7a64f27, State: Running, Role: LEADER
I20260808 08:52:47.975872 12291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } }
I20260808 08:52:47.976114 12273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:47.983557 12294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4868f6e8885d4e79bdf5bb6fc7a64f27. Latest consensus state: current_term: 1 leader_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } } }
I20260808 08:52:47.983696 12293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4868f6e8885d4e79bdf5bb6fc7a64f27" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44587 } } }
I20260808 08:52:47.984186 12294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:47.984259 12293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:47.985085 12306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:47.986038 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:47.968441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39103 (local address 127.8.149.126:44587)
0808 08:52:47.968614 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:47.968618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:47.969257 (+ 639us) server_negotiation.cc:407] Connection header received
0808 08:52:47.969470 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:47.969483 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:47.969548 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:47.969658 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:47.971511 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:47.972465 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:47.974277 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:47.975109 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:47.975271 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:47.978495 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:47.978500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:47.978502 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:47.978530 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:47.981353 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:47.982834 (+ 1481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:47.982842 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:47.982847 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:47.983158 (+ 311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:47.983707 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:47.983713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:47.983718 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:47.984292 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:47.984655 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:47.985454 (+ 799us) server_negotiation.cc:299] Negotiation successful
0808 08:52:47.985647 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:52:47.991755 12306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:48.003646 12306 catalog_manager.cc:1347] Generated new cluster ID: 7145c5f3b1f34ad489e30c9b64fdf314
I20260808 08:52:48.003737 12306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:48.019481 12306 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:48.020804 12306 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:48.033622 12306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4868f6e8885d4e79bdf5bb6fc7a64f27: Generated new TSK 0
I20260808 08:52:48.034405 12306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:48.045341 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12160
I20260808 08:52:48.046605 12266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:48.131397 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12160
W20260808 08:52:48.156659 12133 connection.cc:535] client connection to 127.8.149.126:44587 recv error: Network error: failed to read from TLS socket (remote: 127.8.149.126:44587): Connection reset by peer (error 104)
2026-08-08T08:52:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2213 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:48 dist-test-slave-7vjv krb5kdc[12331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:48 dist-test-slave-7vjv krb5kdc[12331](info): set up 2 sockets
Aug 08 08:52:48 dist-test-slave-7vjv krb5kdc[12331](info): commencing operation
krb5kdc: starting...
W20260808 08:52:49.433000 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:49 dist-test-slave-7vjv krb5kdc[12331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:49.710727 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36759
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:44657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:50.041112 12357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:50.041371 12357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:50.041465 12357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:50.048273 12357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:50.048368 12357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:50.048419 12357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:50.048480 12357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:50.048523 12357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:50.057680 12357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:44657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:36759
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:50.058701 12357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:50.059981 12357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:50.070813 12363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:50.070775 12367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:50.071542 12369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:50.071951 12357 server_base.cc:1034] running on GCE node
I20260808 08:52:50.072746 12357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:50.074060 12357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:50.075269 12357 hybrid_clock.cc:648] HybridClock initialized: now 1786179170075216 us; error 44 us; skew 500 ppm
I20260808 08:52:50.075641 12357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:50 dist-test-slave-7vjv krb5kdc[12331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179170, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:50.079093 12357 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:50.080559 12357 webserver.cc:460] Webserver started at http://127.8.149.126:37983/ using document root <none> and password file <none>
I20260808 08:52:50.081187 12357 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:50.081295 12357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:50.081544 12357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:50.084435 12357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "4788a152b456483da4dbd9f2b46a450d"
format_stamp: "Formatted at 2026-08-08 08:52:50 on dist-test-slave-7vjv"
server_key: "39acc791fa84f8c896b91e54436a2bee"
server_key_iv: "75265d9dc48bee4b696ba0aa225fd449"
server_key_version: "encryptionkey@0"
I20260808 08:52:50.085194 12357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "4788a152b456483da4dbd9f2b46a450d"
format_stamp: "Formatted at 2026-08-08 08:52:50 on dist-test-slave-7vjv"
server_key: "39acc791fa84f8c896b91e54436a2bee"
server_key_iv: "75265d9dc48bee4b696ba0aa225fd449"
server_key_version: "encryptionkey@0"
I20260808 08:52:50.090004 12357 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 08:52:50.093250 12378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:50.094484 12357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:50.094673 12357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "4788a152b456483da4dbd9f2b46a450d"
format_stamp: "Formatted at 2026-08-08 08:52:50 on dist-test-slave-7vjv"
server_key: "39acc791fa84f8c896b91e54436a2bee"
server_key_iv: "75265d9dc48bee4b696ba0aa225fd449"
server_key_version: "encryptionkey@0"
I20260808 08:52:50.094858 12357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:50.110519 12357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:50.114010 12357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:50.114275 12357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:50.132850 12357 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:36759
I20260808 08:52:50.132886 12469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:36759 every 8 connection(s)
I20260808 08:52:50.134027 12357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:50.135686 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12357
I20260808 08:52:50.135865 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:50.136392 8789 external_mini_cluster.cc:1428] Setting key 1386edbbd0aed2e2bc93347e694001c4
I20260808 08:52:50.137925 12470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:50.150583 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:50.138054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60525 (local address 127.8.149.126:36759)
0808 08:52:50.138838 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:50.138852 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:50.138900 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:52:50.140905 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:50.140929 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:50.141388 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:50.141878 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:50.142368 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:50.144371 (+ 2003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:50.145654 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:50.146676 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:50.146854 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:50.147910 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:50.147921 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:50.147940 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:50.148626 (+ 686us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:50.148711 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:50.148755 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:50.148920 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:50.149152 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 08:52:50.149307 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":286,"threads_started":1}
I20260808 08:52:50.151801 12470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d: Bootstrap starting.
I20260808 08:52:50.154275 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:50.154943 12470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:50.156194 12470 log.cc:824] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:50.159147 12470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d: No bootstrap required, opened a new log
I20260808 08:52:50.165863 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:50.159311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39487 (local address 127.8.149.126:36759)
0808 08:52:50.159506 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:50.159513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:50.160060 (+ 547us) server_negotiation.cc:407] Connection header received
0808 08:52:50.160255 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:50.160259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:50.160308 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:50.160380 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:50.160970 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:50.161715 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:50.163503 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:50.163906 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:50.164007 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:50.165154 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:50.165158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:50.165161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:50.165174 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:50.165207 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:50.165223 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:50.165305 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:50.165504 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 08:52:50.165538 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:52:50.168308 12470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } }
I20260808 08:52:50.168630 12470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:50.168751 12470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4788a152b456483da4dbd9f2b46a450d, State: Initialized, Role: FOLLOWER
I20260808 08:52:50.169335 12470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } }
I20260808 08:52:50.169559 12470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:50.169714 12470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:50.169902 12470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:50.171888 12470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } }
I20260808 08:52:50.172439 12470 leader_election.cc:302] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4788a152b456483da4dbd9f2b46a450d; no voters:
I20260808 08:52:50.172976 12470 leader_election.cc:288] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:50.173120 12488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:50.173804 12488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [term 1 LEADER]: Becoming Leader. State: Replica: 4788a152b456483da4dbd9f2b46a450d, State: Running, Role: LEADER
I20260808 08:52:50.174361 12488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } }
I20260808 08:52:50.174945 12470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:50.177106 12489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4788a152b456483da4dbd9f2b46a450d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } } }
I20260808 08:52:50.177484 12489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:50.177893 12490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4788a152b456483da4dbd9f2b46a450d. Latest consensus state: current_term: 1 leader_uuid: "4788a152b456483da4dbd9f2b46a450d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4788a152b456483da4dbd9f2b46a450d" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 36759 } } }
I20260808 08:52:50.178313 12490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:50.180015 12502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:50.185232 12502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:50.195201 12502 catalog_manager.cc:1347] Generated new cluster ID: 5a9cc14be12e4b8a826654be5bc73f77
I20260808 08:52:50.195308 12502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:50.208065 12502 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:50.209615 12502 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:50.214654 12502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4788a152b456483da4dbd9f2b46a450d: Generated new TSK 0
I20260808 08:52:50.215372 12502 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:50.222380 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12357
W20260808 08:52:50.223464 12463 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60525
W20260808 08:52:50.224346 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12357: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:50.224506 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12357
W20260808 08:52:50.252879 12326 connection.cc:535] client connection to 127.8.149.126:36759 recv error: Network error: failed to read from TLS socket (remote: 127.8.149.126:36759): Connection reset by peer (error 104)
2026-08-08T08:52:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2096 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:50 dist-test-slave-7vjv krb5kdc[12522](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:50 dist-test-slave-7vjv krb5kdc[12522](info): set up 2 sockets
Aug 08 08:52:50 dist-test-slave-7vjv krb5kdc[12522](info): commencing operation
krb5kdc: starting...
W20260808 08:52:51.516790 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:51 dist-test-slave-7vjv krb5kdc[12522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:51.789500 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:45963
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:43547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:45963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:52.103914 12541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:52.104228 12541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:52.104375 12541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:52.110766 12541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:52.110903 12541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:52.110998 12541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:52.111094 12541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:52.111167 12541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:52.119442 12541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:43547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:45963
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:45963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:52.120570 12541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:52.121752 12541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:52.133162 12547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:52.133104 12548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:52.133193 12551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:52.134209 12541 server_base.cc:1034] running on GCE node
I20260808 08:52:52.134928 12541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:52.136240 12541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:52.137458 12541 hybrid_clock.cc:648] HybridClock initialized: now 1786179172137403 us; error 44 us; skew 500 ppm
I20260808 08:52:52.137830 12541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:52 dist-test-slave-7vjv krb5kdc[12522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179172, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:52.141026 12541 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:52.142453 12541 webserver.cc:460] Webserver started at http://127.8.149.126:35783/ using document root <none> and password file <none>
I20260808 08:52:52.143061 12541 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:52.143199 12541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:52.143501 12541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:52.146224 12541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c"
format_stamp: "Formatted at 2026-08-08 08:52:52 on dist-test-slave-7vjv"
server_key: "7bf5351de860d2111312cbf7d1a57731"
server_key_iv: "77d0e9ad0b557f00d2514fcd19f6ba0c"
server_key_version: "encryptionkey@0"
I20260808 08:52:52.146931 12541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c"
format_stamp: "Formatted at 2026-08-08 08:52:52 on dist-test-slave-7vjv"
server_key: "7bf5351de860d2111312cbf7d1a57731"
server_key_iv: "77d0e9ad0b557f00d2514fcd19f6ba0c"
server_key_version: "encryptionkey@0"
I20260808 08:52:52.151774 12541 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260808 08:52:52.154978 12568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:52.156174 12541 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:52:52.156385 12541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c"
format_stamp: "Formatted at 2026-08-08 08:52:52 on dist-test-slave-7vjv"
server_key: "7bf5351de860d2111312cbf7d1a57731"
server_key_iv: "77d0e9ad0b557f00d2514fcd19f6ba0c"
server_key_version: "encryptionkey@0"
I20260808 08:52:52.156567 12541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:52.162130 12541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:52.165731 12541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:52.166016 12541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:52.184813 12541 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:45963
I20260808 08:52:52.184842 12659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:45963 every 8 connection(s)
I20260808 08:52:52.186175 12541 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:52.189695 12661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:52.192607 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12541
I20260808 08:52:52.192787 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:52.193260 8789 external_mini_cluster.cc:1428] Setting key 51df1f37c24af83b3938e1ddfb8f5d1b
I20260808 08:52:52.200775 12666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:52.194916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35297 (local address 127.8.149.126:45963)
0808 08:52:52.195760 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:52.195771 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:52.195809 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:52:52.197461 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:52.197481 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:52.197815 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:52.198268 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:52.199263 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:52.199269 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:52.199280 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:52.199300 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:52.199355 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:52.199390 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:52.199551 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:52.199683 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 08:52:52.199850 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":409,"threads_started":1}
I20260808 08:52:52.201622 12661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c: Bootstrap starting.
I20260808 08:52:52.204512 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:52.204787 12661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:52.205716 12661 log.cc:824] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:52.208499 12661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c: No bootstrap required, opened a new log
I20260808 08:52:52.211596 12666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:52.208991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39741 (local address 127.8.149.126:45963)
0808 08:52:52.209143 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:52.209149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:52.209725 (+ 576us) server_negotiation.cc:407] Connection header received
0808 08:52:52.209843 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:52.209848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:52.209911 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:52.210014 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:52.210853 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:52.210858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:52.210862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:52.210878 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:52.210929 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:52.210951 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:52.211065 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:52.211244 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:52:52.211312 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:52:52.216321 12661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } }
I20260808 08:52:52.216622 12661 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:52.216723 12661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fdd9d0fdae14776962e8aa47fd4cf7c, State: Initialized, Role: FOLLOWER
I20260808 08:52:52.217196 12661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } }
I20260808 08:52:52.217415 12661 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:52.217548 12661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:52.217728 12661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:52.219847 12661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } }
I20260808 08:52:52.220391 12661 leader_election.cc:302] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fdd9d0fdae14776962e8aa47fd4cf7c; no voters:
I20260808 08:52:52.220922 12661 leader_election.cc:288] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:52.221099 12677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:52.221803 12677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [term 1 LEADER]: Becoming Leader. State: Replica: 2fdd9d0fdae14776962e8aa47fd4cf7c, State: Running, Role: LEADER
I20260808 08:52:52.222316 12677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } }
I20260808 08:52:52.222949 12661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:52.225332 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } } }
I20260808 08:52:52.225723 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:52.226174 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fdd9d0fdae14776962e8aa47fd4cf7c. Latest consensus state: current_term: 1 leader_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdd9d0fdae14776962e8aa47fd4cf7c" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 45963 } } }
I20260808 08:52:52.226437 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:52.227244 12686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:52.232291 12686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:52.241314 12686 catalog_manager.cc:1347] Generated new cluster ID: 3342f475448d46128c39bc84a3cad1f4
I20260808 08:52:52.241446 12686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:52.254457 12686 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:52.254796 12686 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:52.261006 12686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fdd9d0fdae14776962e8aa47fd4cf7c: Generated new TSK 0
I20260808 08:52:52.262073 12686 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:52.276432 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12541
W20260808 08:52:52.277459 12653 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35297
W20260808 08:52:52.278177 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12541: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:52.278326 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12541
2026-08-08T08:52:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2051 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:52 dist-test-slave-7vjv krb5kdc[12708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:52 dist-test-slave-7vjv krb5kdc[12708](info): set up 2 sockets
Aug 08 08:52:52 dist-test-slave-7vjv krb5kdc[12708](info): commencing operation
krb5kdc: starting...
W20260808 08:52:53.585973 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:53 dist-test-slave-7vjv krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:53.862896 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44413
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:40585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:44413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:54.185196 12726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:54.185508 12726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:54.185689 12726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:54.192713 12726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:54.192886 12726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:54.193001 12726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:54.193104 12726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:54.193187 12726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:54.202234 12726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:40585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:44413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:44413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:54.203472 12726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:54.204734 12726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:54.216168 12732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:54.216195 12735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:54.216116 12733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:54.217221 12726 server_base.cc:1034] running on GCE node
I20260808 08:52:54.217912 12726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:54.219142 12726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:54.220362 12726 hybrid_clock.cc:648] HybridClock initialized: now 1786179174220292 us; error 39 us; skew 500 ppm
I20260808 08:52:54.220708 12726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:54 dist-test-slave-7vjv krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179174, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:54.228204 12726 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:54.229519 12726 webserver.cc:460] Webserver started at http://127.8.149.126:38785/ using document root <none> and password file <none>
I20260808 08:52:54.230087 12726 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:54.230191 12726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:54.230424 12726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:54.233173 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "d9acf4aa284f4b7588140f3c963ea98e"
format_stamp: "Formatted at 2026-08-08 08:52:54 on dist-test-slave-7vjv"
server_key: "f78b8c7776881631599403e27d5414ef"
server_key_iv: "4fc113fea5e4b67da73a8073718872dd"
server_key_version: "encryptionkey@0"
I20260808 08:52:54.233879 12726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "d9acf4aa284f4b7588140f3c963ea98e"
format_stamp: "Formatted at 2026-08-08 08:52:54 on dist-test-slave-7vjv"
server_key: "f78b8c7776881631599403e27d5414ef"
server_key_iv: "4fc113fea5e4b67da73a8073718872dd"
server_key_version: "encryptionkey@0"
I20260808 08:52:54.238572 12726 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 08:52:54.241827 12745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:54.243103 12726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:52:54.243299 12726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "d9acf4aa284f4b7588140f3c963ea98e"
format_stamp: "Formatted at 2026-08-08 08:52:54 on dist-test-slave-7vjv"
server_key: "f78b8c7776881631599403e27d5414ef"
server_key_iv: "4fc113fea5e4b67da73a8073718872dd"
server_key_version: "encryptionkey@0"
I20260808 08:52:54.243508 12726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:54.270071 12726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:54.274331 12726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:54.274644 12726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:54.293325 12726 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:44413
I20260808 08:52:54.293404 12835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:44413 every 8 connection(s)
I20260808 08:52:54.294564 12726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:54.297082 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12726
I20260808 08:52:54.297266 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:54.297708 8789 external_mini_cluster.cc:1428] Setting key dda1a65d5ca23c1b73be29c8577e3ec5
I20260808 08:52:54.298645 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:52:54 dist-test-slave-7vjv krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:52:54.313230 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e: Bootstrap starting.
I20260808 08:52:54.317360 12837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:54.318572 12837 log.cc:824] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:54.321950 12843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:54.299308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39233 (local address 127.8.149.126:44413)
0808 08:52:54.300383 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:54.300393 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:54.300429 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:52:54.301871 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:54.301891 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:54.302224 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:54.302549 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:54.304374 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:54.305799 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:54.307692 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:54.308410 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:54.308533 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:54.313359 (+ 4826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:54.313380 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:54.313397 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:54.313437 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:54.317424 (+ 3987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:54.318093 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:54.318101 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:54.318108 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:54.318318 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:54.318674 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:54.318680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:54.318684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:54.319395 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:54.319631 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:54.320244 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 08:52:54.320689 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":652,"threads_started":1}
I20260808 08:52:54.322003 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e: No bootstrap required, opened a new log
I20260808 08:52:54.325785 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:54.332819 12837 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } }
I20260808 08:52:54.333243 12837 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:54.333403 12837 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9acf4aa284f4b7588140f3c963ea98e, State: Initialized, Role: FOLLOWER
I20260808 08:52:54.333998 12837 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } }
I20260808 08:52:54.334223 12837 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:54.334380 12837 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:54.334543 12837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:54.337121 12837 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } }
I20260808 08:52:54.337597 12837 leader_election.cc:302] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9acf4aa284f4b7588140f3c963ea98e; no voters:
I20260808 08:52:54.338313 12837 leader_election.cc:288] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:54.338419 12857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:54.340395 12857 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [term 1 LEADER]: Becoming Leader. State: Replica: d9acf4aa284f4b7588140f3c963ea98e, State: Running, Role: LEADER
I20260808 08:52:54.344211 12857 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } }
I20260808 08:52:54.345299 12837 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:54.347121 12860 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9acf4aa284f4b7588140f3c963ea98e. Latest consensus state: current_term: 1 leader_uuid: "d9acf4aa284f4b7588140f3c963ea98e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } } }
I20260808 08:52:54.347501 12860 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:54.348129 12859 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9acf4aa284f4b7588140f3c963ea98e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9acf4aa284f4b7588140f3c963ea98e" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 44413 } } }
I20260808 08:52:54.348440 12859 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:54.348969 12843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:54.330155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56489 (local address 127.8.149.126:44413)
0808 08:52:54.330310 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:54.330316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:54.331522 (+ 1206us) server_negotiation.cc:407] Connection header received
0808 08:52:54.331722 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:54.331728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:54.331810 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:54.331937 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:54.333344 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:54.334181 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:54.335860 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:54.336590 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:54.336717 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:54.339821 (+ 3104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:54.339827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:54.339831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:52:54.339865 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:54.345210 (+ 5345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:54.346044 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:54.346049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:54.346052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:54.346247 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:52:54.346783 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:52:54.346790 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:52:54.346795 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:52:54.347234 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:54.347501 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:54.348234 (+ 733us) server_negotiation.cc:299] Negotiation successful
0808 08:52:54.348469 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:52:54.353696 12865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:54.358605 12865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:54.367707 12865 catalog_manager.cc:1347] Generated new cluster ID: 9165a6a2eb5b438bbc9274ecea759e00
I20260808 08:52:54.367796 12865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:54.379887 12865 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:54.381623 12865 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:54.394407 12865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9acf4aa284f4b7588140f3c963ea98e: Generated new TSK 0
I20260808 08:52:54.395251 12865 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:54.400210 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12726
I20260808 08:52:54.401532 12831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:52:54.486625 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12726
2026-08-08T08:52:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2207 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:54 dist-test-slave-7vjv krb5kdc[12894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:54 dist-test-slave-7vjv krb5kdc[12894](info): set up 2 sockets
Aug 08 08:52:54 dist-test-slave-7vjv krb5kdc[12894](info): commencing operation
krb5kdc: starting...
W20260808 08:52:55.784507 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:55 dist-test-slave-7vjv krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:56.063171 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35589
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:35589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:56.392668 12917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:56.392917 12917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:56.393066 12917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:56.399438 12917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:56.399528 12917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:56.399644 12917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:56.399726 12917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:56.399801 12917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:56.408460 12917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:35589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:35589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:56.409535 12917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:56.410745 12917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:56.422066 12926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:56.422137 12933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:56.422091 12927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:56.423151 12917 server_base.cc:1034] running on GCE node
I20260808 08:52:56.423949 12917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:56.425297 12917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:56.426535 12917 hybrid_clock.cc:648] HybridClock initialized: now 1786179176426491 us; error 30 us; skew 500 ppm
I20260808 08:52:56.426918 12917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:56 dist-test-slave-7vjv krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179176, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:56.430123 12917 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:56.431528 12917 webserver.cc:460] Webserver started at http://127.8.149.126:39733/ using document root <none> and password file <none>
I20260808 08:52:56.432320 12917 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:56.432482 12917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:56.432801 12917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:56.435756 12917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "26de0d98db974048b15f2e7e3b606fe4"
format_stamp: "Formatted at 2026-08-08 08:52:56 on dist-test-slave-7vjv"
server_key: "a65ffea63fefb1a65ee29034298f2414"
server_key_iv: "3075508822b5d7cc7cd17e380bf6386d"
server_key_version: "encryptionkey@0"
I20260808 08:52:56.436549 12917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "26de0d98db974048b15f2e7e3b606fe4"
format_stamp: "Formatted at 2026-08-08 08:52:56 on dist-test-slave-7vjv"
server_key: "a65ffea63fefb1a65ee29034298f2414"
server_key_iv: "3075508822b5d7cc7cd17e380bf6386d"
server_key_version: "encryptionkey@0"
I20260808 08:52:56.441479 12917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:52:56.444918 12946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:56.446125 12917 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:52:56.446318 12917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "26de0d98db974048b15f2e7e3b606fe4"
format_stamp: "Formatted at 2026-08-08 08:52:56 on dist-test-slave-7vjv"
server_key: "a65ffea63fefb1a65ee29034298f2414"
server_key_iv: "3075508822b5d7cc7cd17e380bf6386d"
server_key_version: "encryptionkey@0"
I20260808 08:52:56.446518 12917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:56.471624 12917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:56.475703 12917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:56.476025 12917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:56.495512 12917 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:35589
I20260808 08:52:56.495549 13032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:35589 every 8 connection(s)
I20260808 08:52:56.496848 12917 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:56.499455 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 12917
I20260808 08:52:56.499639 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:56.500061 8789 external_mini_cluster.cc:1428] Setting key 8c75d48c15c59b8c74c8ba1e03a50e3e
I20260808 08:52:56.500877 13033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:56.513187 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:56.501891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36475 (local address 127.8.149.126:35589)
0808 08:52:56.502768 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:56.502778 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:56.502818 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:52:56.504388 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:56.504409 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:56.504766 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:56.505064 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:56.505752 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:56.507075 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:56.508944 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:56.509542 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:56.509660 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:56.510991 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:56.511000 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:56.511012 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:56.511542 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:56.511613 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:56.511638 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:56.511726 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:56.511987 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:52:56.512314 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":366,"threads_started":1}
I20260808 08:52:56.514662 13033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4: Bootstrap starting.
I20260808 08:52:56.517001 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:56.518353 13033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:56.519387 13033 log.cc:824] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:56.522634 13033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4: No bootstrap required, opened a new log
I20260808 08:52:56.528014 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:56.521186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57793 (local address 127.8.149.126:35589)
0808 08:52:56.521364 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:56.521382 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:56.521921 (+ 539us) server_negotiation.cc:407] Connection header received
0808 08:52:56.522142 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:56.522146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:56.522199 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:56.522276 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:56.523032 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:56.523751 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:56.525577 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:52:56.526014 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:52:56.526136 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:52:56.527308 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:56.527312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:56.527314 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:56.527328 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:56.527361 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:56.527382 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:56.527467 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:56.527646 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:52:56.527705 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:52:56.531983 13033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } }
I20260808 08:52:56.532402 13033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:56.532517 13033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26de0d98db974048b15f2e7e3b606fe4, State: Initialized, Role: FOLLOWER
I20260808 08:52:56.533077 13033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } }
I20260808 08:52:56.533375 13033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:56.533643 13033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:56.533887 13033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:56.536188 13033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } }
I20260808 08:52:56.536679 13033 leader_election.cc:302] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26de0d98db974048b15f2e7e3b606fe4; no voters:
I20260808 08:52:56.537261 13033 leader_election.cc:288] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:56.537369 13051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:56.538043 13051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [term 1 LEADER]: Becoming Leader. State: Replica: 26de0d98db974048b15f2e7e3b606fe4, State: Running, Role: LEADER
I20260808 08:52:56.538556 13051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } }
I20260808 08:52:56.539222 13033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:56.541280 13052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26de0d98db974048b15f2e7e3b606fe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } } }
I20260808 08:52:56.541641 13052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:56.542825 13054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26de0d98db974048b15f2e7e3b606fe4. Latest consensus state: current_term: 1 leader_uuid: "26de0d98db974048b15f2e7e3b606fe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26de0d98db974048b15f2e7e3b606fe4" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 35589 } } }
I20260808 08:52:56.543397 13054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:56.544047 13057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:56.548044 13057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:56.556434 13057 catalog_manager.cc:1347] Generated new cluster ID: 4999f6c813dc4552a8130eba39c399d2
I20260808 08:52:56.556527 13057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:56.573771 13057 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:56.575387 13057 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:56.586231 13057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26de0d98db974048b15f2e7e3b606fe4: Generated new TSK 0
I20260808 08:52:56.587107 13057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:56.598201 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12917
W20260808 08:52:56.599535 13025 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36475
W20260808 08:52:56.600229 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 12917: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:56.600405 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 12917
2026-08-08T08:52:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2113 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:56 dist-test-slave-7vjv krb5kdc[13086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:56 dist-test-slave-7vjv krb5kdc[13086](info): set up 2 sockets
Aug 08 08:52:56 dist-test-slave-7vjv krb5kdc[13086](info): commencing operation
krb5kdc: starting...
W20260808 08:52:57.899538 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:52:58 dist-test-slave-7vjv krb5kdc[13086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:52:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:52:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:52:58.199357 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40567
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:52:58.527967 13114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:52:58.528298 13114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:52:58.528451 13114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:52:58.535143 13114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:52:58.535279 13114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:52:58.535377 13114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:52:58.535493 13114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:52:58.535573 13114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:52:58.544469 13114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:52:58.545562 13114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:52:58.546783 13114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:52:58.557828 13122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:58.557788 13127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:52:58.557874 13130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:52:58.558667 13114 server_base.cc:1034] running on GCE node
I20260808 08:52:58.559423 13114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:52:58.560719 13114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:52:58.561957 13114 hybrid_clock.cc:648] HybridClock initialized: now 1786179178561931 us; error 44 us; skew 500 ppm
I20260808 08:52:58.562296 13114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:52:58 dist-test-slave-7vjv krb5kdc[13086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179178, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:52:58.565233 13114 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:52:58.566636 13114 webserver.cc:460] Webserver started at http://127.8.149.126:46755/ using document root <none> and password file <none>
I20260808 08:52:58.567243 13114 fs_manager.cc:359] Metadata directory not provided
I20260808 08:52:58.567373 13114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:52:58.567719 13114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:52:58.570528 13114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "0deb7408c3a4470ea0774d9178617dbf"
format_stamp: "Formatted at 2026-08-08 08:52:58 on dist-test-slave-7vjv"
server_key: "8fbecf0294df481157fe4a46ab9d080d"
server_key_iv: "f76ec485bfad3779e591385e8a78b326"
server_key_version: "encryptionkey@0"
I20260808 08:52:58.571272 13114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "0deb7408c3a4470ea0774d9178617dbf"
format_stamp: "Formatted at 2026-08-08 08:52:58 on dist-test-slave-7vjv"
server_key: "8fbecf0294df481157fe4a46ab9d080d"
server_key_iv: "f76ec485bfad3779e591385e8a78b326"
server_key_version: "encryptionkey@0"
I20260808 08:52:58.576288 13114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:52:58.579545 13145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:52:58.580826 13114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:52:58.581022 13114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "0deb7408c3a4470ea0774d9178617dbf"
format_stamp: "Formatted at 2026-08-08 08:52:58 on dist-test-slave-7vjv"
server_key: "8fbecf0294df481157fe4a46ab9d080d"
server_key_iv: "f76ec485bfad3779e591385e8a78b326"
server_key_version: "encryptionkey@0"
I20260808 08:52:58.581200 13114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:52:58.586649 13114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:52:58.590443 13114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:52:58.590731 13114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:52:58.609679 13114 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40567
I20260808 08:52:58.609709 13228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40567 every 8 connection(s)
I20260808 08:52:58.611186 13114 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:52:58.614797 13230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:52:58.616012 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13114
I20260808 08:52:58.616246 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:52:58.616822 8789 external_mini_cluster.cc:1428] Setting key a594e528bef5623b7dd4606c81b72227
I20260808 08:52:58.624624 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:58.618704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43253 (local address 127.8.149.126:40567)
0808 08:52:58.619584 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:58.619595 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:58.619646 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:52:58.621469 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:58.621489 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:58.621820 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:58.622208 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:58.623169 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:58.623174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:58.623185 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:58.623197 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:58.623243 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:58.623262 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:58.623479 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:58.623600 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 08:52:58.623759 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":440,"threads_started":1}
I20260808 08:52:58.627570 13230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf: Bootstrap starting.
I20260808 08:52:58.627831 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:52:58.630375 13230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf: Neither blocks nor log segments found. Creating new log.
I20260808 08:52:58.631466 13230 log.cc:824] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:52:58.634249 13233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:52:58.631658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57815 (local address 127.8.149.126:40567)
0808 08:52:58.631786 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 08:52:58.631790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:52:58.632411 (+ 621us) server_negotiation.cc:407] Connection header received
0808 08:52:58.632595 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:52:58.632599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:52:58.632641 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:52:58.632721 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:52:58.633624 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:52:58.633629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:52:58.633633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:52:58.633652 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:52:58.633691 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:52:58.633705 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:52:58.633807 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:52:58.633966 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 08:52:58.634017 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 08:52:58.634532 13230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf: No bootstrap required, opened a new log
I20260808 08:52:58.641839 13230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } }
I20260808 08:52:58.642149 13230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:52:58.642243 13230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0deb7408c3a4470ea0774d9178617dbf, State: Initialized, Role: FOLLOWER
I20260808 08:52:58.642778 13230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } }
I20260808 08:52:58.643050 13230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:52:58.643196 13230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:52:58.643376 13230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:52:58.645368 13230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } }
I20260808 08:52:58.645767 13230 leader_election.cc:302] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0deb7408c3a4470ea0774d9178617dbf; no voters:
I20260808 08:52:58.646245 13230 leader_election.cc:288] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:52:58.646368 13245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:52:58.646992 13245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [term 1 LEADER]: Becoming Leader. State: Replica: 0deb7408c3a4470ea0774d9178617dbf, State: Running, Role: LEADER
I20260808 08:52:58.647480 13245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } }
I20260808 08:52:58.648181 13230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:52:58.650199 13248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0deb7408c3a4470ea0774d9178617dbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } } }
I20260808 08:52:58.650663 13248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:58.651722 13249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0deb7408c3a4470ea0774d9178617dbf. Latest consensus state: current_term: 1 leader_uuid: "0deb7408c3a4470ea0774d9178617dbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0deb7408c3a4470ea0774d9178617dbf" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40567 } } }
I20260808 08:52:58.652133 13249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf [sys.catalog]: This master's current role is: LEADER
I20260808 08:52:58.652992 13257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:52:58.657244 13257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:52:58.664548 13257 catalog_manager.cc:1347] Generated new cluster ID: a360cb421cdf4bb0a7f658848dbe9c93
I20260808 08:52:58.664665 13257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:52:58.686180 13257 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:52:58.686609 13257 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:52:58.696447 13257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0deb7408c3a4470ea0774d9178617dbf: Generated new TSK 0
I20260808 08:52:58.697273 13257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:52:58.707026 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13114
W20260808 08:52:58.708205 13219 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43253
W20260808 08:52:58.708911 8789 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13114: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:52:58.709070 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13114
2026-08-08T08:52:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2110 ms)
[----------] 18 tests from AuthTokenIssuingTest (38719 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:52:58 dist-test-slave-7vjv krb5kdc[13278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:52:58 dist-test-slave-7vjv krb5kdc[13278](info): set up 2 sockets
Aug 08 08:52:58 dist-test-slave-7vjv krb5kdc[13278](info): commencing operation
krb5kdc: starting...
W20260808 08:53:00.021831 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:53:00 dist-test-slave-7vjv krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:53:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:53:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:53:00.307651 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:34245
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:53:00.632097 13304 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:00.632462 13304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:00.632586 13304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:00.632736 13304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:00.641067 13304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:00.641171 13304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:00.641263 13304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:53:00.641350 13304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:00.641433 13304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:00.650833 13304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:34245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:00.651989 13304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:00.653211 13304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:53:00.663959 13314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:00.663918 13315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:00.663959 13317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:00.664950 13304 server_base.cc:1034] running on GCE node
I20260808 08:53:00.665661 13304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:00.666901 13304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:00.668177 13304 hybrid_clock.cc:648] HybridClock initialized: now 1786179180668068 us; error 48 us; skew 500 ppm
I20260808 08:53:00.668476 13304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:00 dist-test-slave-7vjv krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:00.671645 13304 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:53:00.673156 13304 webserver.cc:460] Webserver started at http://127.8.149.126:33923/ using document root <none> and password file <none>
I20260808 08:53:00.673779 13304 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:00.673898 13304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:00.674182 13304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:00.676849 13304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "c63ac988054a4e7b957acaf83fcecd37"
format_stamp: "Formatted at 2026-08-08 08:53:00 on dist-test-slave-7vjv"
server_key: "b01d364423184362b64ef860aff7effa"
server_key_iv: "e4c8471261197bc07d095ffdf2e6140e"
server_key_version: "encryptionkey@0"
I20260808 08:53:00.677587 13304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "c63ac988054a4e7b957acaf83fcecd37"
format_stamp: "Formatted at 2026-08-08 08:53:00 on dist-test-slave-7vjv"
server_key: "b01d364423184362b64ef860aff7effa"
server_key_iv: "e4c8471261197bc07d095ffdf2e6140e"
server_key_version: "encryptionkey@0"
I20260808 08:53:00.682497 13304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:53:00.685846 13328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:00.687175 13304 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:53:00.687346 13304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "c63ac988054a4e7b957acaf83fcecd37"
format_stamp: "Formatted at 2026-08-08 08:53:00 on dist-test-slave-7vjv"
server_key: "b01d364423184362b64ef860aff7effa"
server_key_iv: "e4c8471261197bc07d095ffdf2e6140e"
server_key_version: "encryptionkey@0"
I20260808 08:53:00.687544 13304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:00.715056 13304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:00.718951 13304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:00.719183 13304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:00.737533 13304 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:34245
I20260808 08:53:00.737565 13412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:34245 every 8 connection(s)
I20260808 08:53:00.738837 13304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:53:00.741801 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13304
I20260808 08:53:00.742010 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:53:00.742372 13413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:00.742699 8789 external_mini_cluster.cc:1428] Setting key 9a371c6e093269489c64d24a85ddc5d0
I20260808 08:53:00.748489 13413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:00 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:00.771432 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.751226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34245 (local address 127.0.0.1:50512)
0808 08:53:00.752149 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.752206 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:00.754382 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:00.755278 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:00.755286 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:00.755997 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:00.756451 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:00.756471 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:00.758053 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:00.758059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:00.759263 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:00.759276 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:00.760628 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:00.760633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:00.760743 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:00.761383 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:00.761422 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:00.763488 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:00.767814 (+ 4326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:00.767823 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:00.767830 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:00.768241 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:00.768662 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:00.768665 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:00.768667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:00.768808 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:00.769698 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:00.769704 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:00.769877 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 08:53:00.770088 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 08:53:00.770430 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"spinlock_wait_cycles":8064,"thread_start_us":353,"threads_started":1}
I20260808 08:53:00.771468 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.751223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50512 (local address 127.8.149.126:34245)
0808 08:53:00.752804 (+ 1581us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:00.752815 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:00.752868 (+ 53us) server_negotiation.cc:407] Connection header received
0808 08:53:00.754752 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:00.754762 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:00.755044 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:00.755242 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:00.756656 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:00.757903 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:00.759406 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:00.760414 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:00.760619 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:00.763717 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:00.763729 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:00.763745 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:00.763785 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:00.767654 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:00.768358 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:00.768368 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:00.768373 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:00.768555 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:00.768921 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:00.768928 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:00.768933 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:00.769566 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:00.769755 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:00.770275 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 08:53:00.770598 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":1368,"spinlock_wait_cycles":37248,"thread_start_us":1176,"threads_started":1}
I20260808 08:53:00.774430 13413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:00.775434 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.775116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56742)
0808 08:53:00.775255 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.775337 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:53:00.775677 13329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
I20260808 08:53:00.777091 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.776783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56746)
0808 08:53:00.776905 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.776973 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 08:53:00.777268 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:46061: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.8.149.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
I20260808 08:53:00.815207 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:46061
--webserver_interface=127.8.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:53:00.826568 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } attempt: 1
I20260808 08:53:00.827648 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.827189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56752)
0808 08:53:00.827403 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.827521 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:53:00.828655 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.828269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56754)
0808 08:53:00.828429 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.828489 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 08:53:00.828969 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:46061: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
I20260808 08:53:00.897205 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } attempt: 2
I20260808 08:53:00.898414 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.897974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56764)
0808 08:53:00.898164 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.898256 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:53:00.899343 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.899019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56778)
0808 08:53:00.899156 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.899232 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:53:00.899523 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:46061: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
I20260808 08:53:00.990772 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } attempt: 3
I20260808 08:53:00.991968 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.991505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56780)
0808 08:53:00.991703 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.991800 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 08:53:00.993052 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:00.992709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56794)
0808 08:53:00.992848 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:00.992922 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:53:00.993221 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:46061: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
I20260808 08:53:01.136511 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } attempt: 4
I20260808 08:53:01.137738 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.137134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56798)
0808 08:53:01.137511 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.137598 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260808 08:53:01.138696 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.138347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56814)
0808 08:53:01.138502 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.138582 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:53:01.138861 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:46061: Network error: Client connection negotiation failed: client connection to 127.8.149.125:46061: connect: Connection refused (error 111)
W20260808 08:53:01.156078 13425 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:01.156436 13425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:01.156548 13425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:01.156665 13425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:01.163160 13425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:01.163264 13425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:01.163380 13425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:53:01.163462 13425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:01.163571 13425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:01.172648 13425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:46061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:01.173803 13425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:01.175067 13425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:53:01.186281 13434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:01.186318 13435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:01.186235 13438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:01.187665 13425 server_base.cc:1034] running on GCE node
I20260808 08:53:01.188429 13425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:01.189622 13425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:01.190872 13425 hybrid_clock.cc:648] HybridClock initialized: now 1786179181190786 us; error 51 us; skew 500 ppm
I20260808 08:53:01.191260 13425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:01.194548 13425 init.cc:377] Logged in from keytab as kudu/127.8.149.125@KRBTEST.COM (short username kudu)
I20260808 08:53:01.196441 13425 webserver.cc:460] Webserver started at http://127.8.149.125:37641/ using document root <none> and password file <none>
I20260808 08:53:01.197085 13425 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:01.197206 13425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:01.197522 13425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:01.200305 13425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data/instance:
uuid: "437e795ea75742a683bce9172c3725be"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "ece5647bfc6a2d368ee860d122514db3"
server_key_iv: "d9c49b9ffdba7570dbcdc10f6b8839ae"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.201030 13425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal/instance:
uuid: "437e795ea75742a683bce9172c3725be"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "ece5647bfc6a2d368ee860d122514db3"
server_key_iv: "d9c49b9ffdba7570dbcdc10f6b8839ae"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.205673 13425 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 08:53:01.208886 13448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:01.210207 13425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:53:01.210384 13425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "437e795ea75742a683bce9172c3725be"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "ece5647bfc6a2d368ee860d122514db3"
server_key_iv: "d9c49b9ffdba7570dbcdc10f6b8839ae"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.210587 13425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:01.229281 13425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:01.233065 13425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:01.233322 13425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:01.251051 13425 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.125:46061
I20260808 08:53:01.251087 13551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.125:46061 every 8 connection(s)
I20260808 08:53:01.252319 13425 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
I20260808 08:53:01.253701 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13425
I20260808 08:53:01.253934 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-1/wal/instance
I20260808 08:53:01.254489 8789 external_mini_cluster.cc:1428] Setting key c6cf4e51d640071ca4c24afb087b6799
I20260808 08:53:01.256654 13553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:01.266185 13553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:01.288700 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.269289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50520 (local address 127.8.149.126:34245)
0808 08:53:01.269468 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.269472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.270780 (+ 1308us) server_negotiation.cc:407] Connection header received
0808 08:53:01.272623 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.272631 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.272723 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.272842 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.274267 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.275468 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.276916 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.277657 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.277789 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.281591 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.281599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.281607 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.281652 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.285542 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.286250 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.286257 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.286262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.286439 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.286861 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.286869 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.286872 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.287296 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.287483 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.288048 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.288310 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:53:01.289304 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.269821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34245 (local address 127.0.0.1:50520)
0808 08:53:01.270606 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.270656 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.272372 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.273066 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.273073 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.273532 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.274100 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.274115 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.275615 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.275619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.276780 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.276791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.277843 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.277847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.278048 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.278792 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.278825 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.281343 (+ 2518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.285694 (+ 4351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.285700 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.285710 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.286112 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.286549 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.286552 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.286554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.286718 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.287431 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.287436 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.287698 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.287894 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.288268 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":338,"threads_started":1}
WARNING: no policy specified for kudu/127.8.149.124@KRBTEST.COM; defaulting to no policy
I20260808 08:53:01.291033 13553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.124@KRBTEST.COM" created.
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:01.305431 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.291701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56824)
0808 08:53:01.291881 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.291899 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.292029 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.293145 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.293149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.293564 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.293687 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.293694 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.294928 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.294932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.295800 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.295810 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.296684 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.296689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.296882 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.297458 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.297485 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.299854 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.302828 (+ 2974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.302836 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.302842 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.303424 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.303787 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.303795 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.303801 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.303996 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.304762 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.304766 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.304882 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.304998 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.305175 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":5}
I20260808 08:53:01.305956 13559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.291935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56824 (local address 127.8.149.125:46061)
0808 08:53:01.292691 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.292700 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.292732 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:53:01.292784 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.292795 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.293010 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.293148 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.293842 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.294800 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.295947 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.296527 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.296674 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.300051 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.300061 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.300071 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.300150 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.302700 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.303563 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.303568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.303571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.303681 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.304155 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.304158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.304175 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.304626 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.304836 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.305169 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.305454 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":567,"thread_start_us":416,"threads_started":1}
I20260808 08:53:01.308279 13553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:01.309327 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.308911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36214)
0808 08:53:01.309109 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.309202 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:53:01.309536 13451 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.311091 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.310674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36222)
0808 08:53:01.310845 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.310949 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 08:53:01.311326 13553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
I20260808 08:53:01.329032 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:44665
--webserver_interface=127.8.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:39115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:53:01.360644 13553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 1
I20260808 08:53:01.361845 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.361317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36232)
0808 08:53:01.361530 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.361652 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 08:53:01.362856 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.362475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36236)
0808 08:53:01.362646 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.362733 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:53:01.363063 13553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.431303 13553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 2
I20260808 08:53:01.432578 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.432035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36244)
0808 08:53:01.432259 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.432369 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 08:53:01.433589 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.433208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36250)
0808 08:53:01.433362 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.433447 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 08:53:01.433804 13553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.438097 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } attempt: 5
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:01.451215 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.438680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56840)
0808 08:53:01.438860 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.438880 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.439036 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.439351 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.439355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.439754 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.439932 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.439941 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.440870 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.440877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.441663 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.441681 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.442446 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.442451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.442653 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.443262 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.443279 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.445170 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.448837 (+ 3667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.448842 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.448844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.449252 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.449665 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.449669 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.449671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.449808 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.450415 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.450419 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.450555 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.450727 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.450967 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:53:01.451313 13559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.438728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.8.149.125:46061)
0808 08:53:01.438880 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.438886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.438958 (+ 72us) server_negotiation.cc:407] Connection header received
0808 08:53:01.439167 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.439171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.439225 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.439317 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.440072 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.440744 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.441855 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.442296 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.442434 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.445412 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.445419 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.445423 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.445458 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.448712 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.449365 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.449371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.449374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.449516 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.449953 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.449957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.449960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.450289 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.450444 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.450863 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.451065 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:53:01.452425 13413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:01.453548 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.453146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36258)
0808 08:53:01.453316 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.453407 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:53:01.454416 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.454123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36268)
0808 08:53:01.454263 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.454328 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 08:53:01.454635 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.505993 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 1
I20260808 08:53:01.507193 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.506721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36272)
0808 08:53:01.506929 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.507025 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:53:01.508230 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.507837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36280)
0808 08:53:01.507985 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.508052 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:53:01.508496 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.525040 13553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 3
I20260808 08:53:01.526262 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.525651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36292)
0808 08:53:01.525886 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.526041 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 08:53:01.527611 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.526885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36304)
0808 08:53:01.527168 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.527269 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260808 08:53:01.527872 13553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.576711 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 2
I20260808 08:53:01.577930 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.577326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36320)
0808 08:53:01.577576 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.577677 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 08:53:01.578819 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.578517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36326)
0808 08:53:01.578651 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.578726 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 08:53:01.579010 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
W20260808 08:53:01.663357 13564 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:01.663647 13564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:01.663759 13564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:01.663868 13564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:01.670864 13564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:01.670964 13564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:01.671056 13564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:53:01.671128 13564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:01.671208 13564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:01.671125 13553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 4
I20260808 08:53:01.672355 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.671780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36328)
0808 08:53:01.672038 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.672177 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 08:53:01.673436 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.673015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36342)
0808 08:53:01.673166 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.673257 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:53:01.673647 13553 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
I20260808 08:53:01.681063 13564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:39115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:34245,127.8.149.125:46061,127.8.149.124:44665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:44665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:01.682212 13564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:01.683511 13564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:53:01.685225 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 3
I20260808 08:53:01.686306 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.685804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36348)
0808 08:53:01.686048 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.686140 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:53:01.687367 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.686985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36364)
0808 08:53:01.687176 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.687259 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260808 08:53:01.687599 13413 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:44665: Network error: Client connection negotiation failed: client connection to 127.8.149.124:44665: connect: Connection refused (error 111)
W20260808 08:53:01.695158 13585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:01.695133 13589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:01.695713 13582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:01.695940 13564 server_base.cc:1034] running on GCE node
I20260808 08:53:01.696761 13564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:01.698040 13564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:01.699277 13564 hybrid_clock.cc:648] HybridClock initialized: now 1786179181699207 us; error 46 us; skew 500 ppm
I20260808 08:53:01.699622 13564 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:01.702777 13564 init.cc:377] Logged in from keytab as kudu/127.8.149.124@KRBTEST.COM (short username kudu)
I20260808 08:53:01.704020 13564 webserver.cc:460] Webserver started at http://127.8.149.124:36263/ using document root <none> and password file <none>
I20260808 08:53:01.704788 13564 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:01.704881 13564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:01.705140 13564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:01.707814 13564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data/instance:
uuid: "dcc3f11bc9e14d458bce52ea0539554e"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "0cde96d937e24c8100c60682438dcd48"
server_key_iv: "bc627fa2f1032ff9be4a174e498ff665"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.708657 13564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal/instance:
uuid: "dcc3f11bc9e14d458bce52ea0539554e"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "0cde96d937e24c8100c60682438dcd48"
server_key_iv: "bc627fa2f1032ff9be4a174e498ff665"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.713459 13564 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:53:01.716662 13596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:01.717818 13564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260808 08:53:01.717989 13564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "dcc3f11bc9e14d458bce52ea0539554e"
format_stamp: "Formatted at 2026-08-08 08:53:01 on dist-test-slave-7vjv"
server_key: "0cde96d937e24c8100c60682438dcd48"
server_key_iv: "bc627fa2f1032ff9be4a174e498ff665"
server_key_version: "encryptionkey@0"
I20260808 08:53:01.718179 13564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:01.741008 13564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:01.746263 13564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:01.746560 13564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:01.766184 13564 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.124:44665
I20260808 08:53:01.766191 13680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.124:44665 every 8 connection(s)
I20260808 08:53:01.767477 13564 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
I20260808 08:53:01.770931 13681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:01.776870 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13564
I20260808 08:53:01.777096 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178813799529-8789-0/minicluster-data/master-2/wal/instance
I20260808 08:53:01.777501 8789 external_mini_cluster.cc:1428] Setting key 26f4bcf31dc866ab2aec2ca869a7e762
I20260808 08:53:01.777112 13681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:53:01.797740 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.779806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50524 (local address 127.8.149.126:34245)
0808 08:53:01.780031 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.780038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.780715 (+ 677us) server_negotiation.cc:407] Connection header received
0808 08:53:01.782296 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.782305 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.782394 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.782502 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.784603 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.785422 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.787541 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.788030 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.788261 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.791694 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.791720 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.791724 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.791758 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.794689 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.795420 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.795427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.795431 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.795582 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.796067 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.796074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.796078 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.796398 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.796589 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.797099 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.797335 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:53:01.798403 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.779374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36380 (local address 127.8.149.124:44665)
0808 08:53:01.780357 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.780374 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.780419 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:53:01.782012 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.782032 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.782239 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.782391 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.784473 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.785644 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.787404 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.787903 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.788103 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.792046 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.792053 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.792080 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.792144 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.794509 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.795159 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.795166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.795170 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.795332 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.795720 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.795725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.795729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.796242 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.796565 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.796924 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.797531 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":246,"server-negotiator.queue_time_us":730,"thread_start_us":462,"threads_started":1}
I20260808 08:53:01.798488 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.779803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:34245 (local address 127.0.0.1:50524)
0808 08:53:01.780568 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.780601 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.782030 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.782790 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.782798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.783692 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.784344 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.784372 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.785594 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.785600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.787415 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.787433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.788364 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.788374 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.788556 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.789115 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.789141 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.791502 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.794845 (+ 3343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.794859 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.794869 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.795284 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.795729 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.795735 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.795739 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.795944 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.796562 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.796570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.796762 (+ 192us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.796991 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.797413 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":1,"spinlock_wait_cycles":37504,"thread_start_us":433,"threads_started":1}
I20260808 08:53:01.800081 13681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:01.815377 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.800891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:46061 (local address 127.0.0.1:56852)
0808 08:53:01.801154 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.801168 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.801257 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.801600 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.801605 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.802007 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.802202 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.802212 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.803629 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.803633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.804929 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.804944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.805908 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.805912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.806051 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.806579 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.806608 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.809253 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.812694 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.812700 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.812704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.813077 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.813498 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.813504 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.813508 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.813655 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.814328 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.814333 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.814496 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.814656 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.814945 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260808 08:53:01.815418 13559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.800882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.8.149.125:46061)
0808 08:53:01.801052 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.801057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.801235 (+ 178us) server_negotiation.cc:407] Connection header received
0808 08:53:01.801360 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.801366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.801455 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.801551 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.802367 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.803491 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.805095 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.805772 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.805912 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.809444 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.809448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.809451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.809479 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.812544 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.813210 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.813216 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.813232 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.813377 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.813767 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.813774 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.813777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.814203 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.814363 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.814754 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.814993 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:53:01.816419 13681 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:01.818001 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.801815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50540 (local address 127.8.149.126:34245)
0808 08:53:01.801996 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.802001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.802018 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:53:01.802120 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.802126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.802195 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.802300 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.803867 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.804993 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.806711 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.807341 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.807454 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.812075 (+ 4621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.812080 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.812082 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.812154 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.814777 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.815747 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.815753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.815757 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.815933 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.816404 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.816411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.816416 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.816756 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.817044 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.817564 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.817781 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:01.829407 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.817124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36390)
0808 08:53:01.817282 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.817299 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.817396 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.817754 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.817757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.818031 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.818173 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.818183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.819202 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.819209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.820564 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.820582 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.821396 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.821402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.821600 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.822119 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.822134 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.824487 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.827299 (+ 2812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.827305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.827308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.827606 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.827930 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.827935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.827940 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.828147 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.828709 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.828712 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.828821 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.828928 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.829095 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:53:01.829622 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.817304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36390 (local address 127.8.149.124:44665)
0808 08:53:01.817453 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.817458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.817473 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:53:01.817514 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.817519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.817570 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.817648 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.818303 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.819080 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.820732 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.821172 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.821351 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.824643 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.824648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.824651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.824676 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.827159 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.827716 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.827719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.827721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.827824 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.828255 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.828258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.828260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.828594 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.828747 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.829104 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.829299 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:53:01.835188 13559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.819516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56862 (local address 127.8.149.125:46061)
0808 08:53:01.819685 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.819689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.819708 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:53:01.819748 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.819753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.819801 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.819890 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.821272 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.822137 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.823817 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.824486 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.824615 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.829316 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.829322 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.829326 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.829369 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.832648 (+ 3279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.833323 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.833329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.833333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.833484 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.833816 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.833821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.833824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.834175 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.834433 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.834623 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.834847 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:53:01.835454 13681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: Bootstrap starting.
I20260808 08:53:01.839048 13681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:01.839872 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:53:01.840281 13681 log.cc:824] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:01.842967 13681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: No bootstrap required, opened a new log
I20260808 08:53:01.843096 13368 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c63ac988054a4e7b957acaf83fcecd37"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50540
I20260808 08:53:01.849489 13681 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.849778 13681 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc3f11bc9e14d458bce52ea0539554e, State: Initialized, Role: FOLLOWER
I20260808 08:53:01.850169 13681 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.851055 13700 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:01.851482 13700 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:01.851881 13681 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:53:01.860837 13716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:53:01.861003 13716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:53:01.864811 13413 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 4
I20260808 08:53:01.858425 13564 master_runner.cc:186] Error getting master registration for 127.8.149.126:34245: OK, instance_id { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" instance_seqno: 1786179180732491 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:53:01.869148 13564 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 08 08:53:01 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179180, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:53:01.881067 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.865376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36400)
0808 08:53:01.865557 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.865577 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.865680 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.866007 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.866013 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.866512 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.866703 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.866714 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.868149 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.868155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.869559 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.869574 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.870395 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.870401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:01.870661 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.871443 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:01.871467 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:01.874356 (+ 2889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:01.878255 (+ 3899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.878259 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.878261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.878773 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.879146 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:01.879150 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:01.879154 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:01.879305 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:01.880041 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:01.880045 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:01.880248 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 08:53:01.880404 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:53:01.880680 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 08:53:01.881091 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.865440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.8.149.124:44665)
0808 08:53:01.865617 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.865622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.865640 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:53:01.865790 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.865794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.865873 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.865975 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.866867 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.867981 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.869709 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.870237 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.870416 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:01.874568 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:01.874575 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:01.874579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:01.874614 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:01.878113 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.878895 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.878901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.878905 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.879036 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:01.879426 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:01.879431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:01.879434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:01.879906 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:01.880067 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:01.880524 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 08:53:01.880730 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:53:01.886575 13413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: Bootstrap starting.
I20260808 08:53:01.890483 13413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:01.891898 13413 log.cc:824] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:01.894903 13413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: No bootstrap required, opened a new log
I20260808 08:53:01.900064 13413 raft_consensus.cc:348] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.900488 13413 raft_consensus.cc:729] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c63ac988054a4e7b957acaf83fcecd37, State: Initialized, Role: FOLLOWER
I20260808 08:53:01.900913 13413 consensus_queue.cc:260] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.902016 13722 sys_catalog.cc:455] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:01.902487 13722 sys_catalog.cc:458] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:01.903146 13413 sys_catalog.cc:564] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:53:01.903370 13368 raft_consensus.cc:482] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:53:01.903577 13368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:01.906980 13368 raft_consensus.cc:504] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.909765 13637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c63ac988054a4e7b957acaf83fcecd37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dcc3f11bc9e14d458bce52ea0539554e"
I20260808 08:53:01.910265 13637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:01.913496 13637 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c63ac988054a4e7b957acaf83fcecd37 in term 1.
I20260808 08:53:01.914055 13332 leader_election.cc:302] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c63ac988054a4e7b957acaf83fcecd37, dcc3f11bc9e14d458bce52ea0539554e; no voters:
I20260808 08:53:01.914423 13368 leader_election.cc:288] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [CANDIDATE]: Term 1 election: Requested vote from peers 437e795ea75742a683bce9172c3725be (127.8.149.125:46061), dcc3f11bc9e14d458bce52ea0539554e (127.8.149.124:44665)
I20260808 08:53:01.914532 13722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:53:01.941352 13722 raft_consensus.cc:686] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [term 1 LEADER]: Becoming Leader. State: Replica: c63ac988054a4e7b957acaf83fcecd37, State: Running, Role: LEADER
I20260808 08:53:01.942993 13722 consensus_queue.cc:237] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:01.955979 13731 sys_catalog.cc:455] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c63ac988054a4e7b957acaf83fcecd37. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:01.956450 13731 sys_catalog.cc:458] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: This master's current role is: LEADER
I20260808 08:53:01.967730 13751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260808 08:53:01.971904 13338 tablet.cc:2369] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:53:01.972841 13553 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } attempt: 5
I20260808 08:53:01.973218 13755 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:53:01.980424 13751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:53:01.977977 13304 master_runner.cc:186] Error getting master registration for 127.8.149.125:46061: OK, instance_id { permanent_uuid: "437e795ea75742a683bce9172c3725be" instance_seqno: 1786179181245976 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:53:01.998503 13304 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:53:01.999171 13605 tablet.cc:2369] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:53:02.003566 13637 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [term 1 FOLLOWER]: Refusing update from remote peer c63ac988054a4e7b957acaf83fcecd37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:53:02.004793 13722 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 08 08:53:02 dist-test-slave-7vjv krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179181, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:53:02.014366 13559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.947239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56874 (local address 127.8.149.125:46061)
0808 08:53:01.947427 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.947433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.968298 (+ 20865us) server_negotiation.cc:407] Connection header received
0808 08:53:01.970574 (+ 2276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.970581 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.970667 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.970739 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.982282 (+ 11543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.983398 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.992488 (+ 9090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.993422 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.993540 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:02.004295 (+ 10755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:02.004302 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:02.004310 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:02.004349 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:02.008164 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.009032 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.009037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.009041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.009204 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.009665 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.009671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.009674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.010066 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:02.010313 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:02.013618 (+ 3305us) server_negotiation.cc:299] Negotiation successful
0808 08:53:02.013909 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:53:02.019930 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.964450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.8.149.126:34245)
0808 08:53:01.964617 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.964623 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.975596 (+ 10973us) server_negotiation.cc:407] Connection header received
0808 08:53:01.977413 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.977422 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.977519 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.977601 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.987673 (+ 10072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.988863 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.000322 (+ 11459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:02.001138 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.001269 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:02.010812 (+ 9543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:02.010818 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:02.010824 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:02.010864 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:02.016467 (+ 5603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.017399 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.017406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.017409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.017590 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.018102 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.018106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.018109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.018472 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:02.018724 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:02.019298 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 08:53:02.019523 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:53:02.023161 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.973959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36416 (local address 127.8.149.124:44665)
0808 08:53:01.997567 (+ 23608us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.997574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.997596 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:53:01.997660 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.997665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.997762 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.000251 (+ 2489us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.000528 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:02.001736 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.003797 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:02.004483 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.004646 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:02.012479 (+ 7833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:02.012485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:02.012490 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:02.012529 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:02.018149 (+ 5620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.019511 (+ 1362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.019516 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.019520 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.019703 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.020567 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.020575 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.020580 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.021275 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:02.021418 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:02.022468 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0808 08:53:02.022668 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23424,"thread_start_us":27873,"threads_started":1}
I20260808 08:53:02.023550 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.973482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:44665 (local address 127.0.0.1:36416)
0808 08:53:01.973723 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:01.973749 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:01.973870 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:01.997959 (+ 24089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:01.997964 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:01.998503 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:01.998770 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:01.998785 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:02.001870 (+ 3085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.001885 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:02.003272 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:02.003287 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:02.004708 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:02.004714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:02.004977 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:02.008367 (+ 3390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:02.008390 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:02.012263 (+ 3873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:02.018315 (+ 6052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:02.018320 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:02.018323 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:02.019308 (+ 985us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:02.019925 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:02.019930 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:02.019933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:02.020294 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:02.021698 (+ 1404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:02.021705 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:02.022095 (+ 390us) client_negotiation.cc:769] Sending connection context
0808 08:53:02.022348 (+ 253us) client_negotiation.cc:240] Negotiation successful
0808 08:53:02.023039 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:53:02.029438 13553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: Bootstrap starting.
I20260808 08:53:02.030057 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:01.953272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36406 (local address 127.8.149.124:44665)
0808 08:53:01.953448 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:01.953454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:01.970285 (+ 16831us) server_negotiation.cc:407] Connection header received
0808 08:53:01.972390 (+ 2105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:01.972396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:01.972481 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:01.972552 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:01.978685 (+ 6133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.980286 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.990465 (+ 10179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:01.991198 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:01.991305 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:02.011757 (+ 20452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:02.011763 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:02.011768 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:02.011805 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:02.019767 (+ 7962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.021740 (+ 1973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.021745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.021748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.021901 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:02.022392 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:02.022397 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:02.022399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:02.022740 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:02.023002 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:02.028860 (+ 5858us) server_negotiation.cc:299] Negotiation successful
0808 08:53:02.029729 (+ 869us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:53:02.034125 13553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:02.035529 13553 log.cc:824] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:02.037365 13700 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c63ac988054a4e7b957acaf83fcecd37. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.037667 13700 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:02.041234 13758 mvcc.cc:205] Tried to move back new op lower bound from 7316189929469149184 to 7316189929252237312. Current Snapshot: MvccSnapshot[applied={T|T < 7316189929469149184}]
I20260808 08:53:02.051751 13731 sys_catalog.cc:455] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.052109 13731 sys_catalog.cc:458] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: This master's current role is: LEADER
I20260808 08:53:02.053020 13700 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.053262 13700 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:02.055871 13751 catalog_manager.cc:1347] Generated new cluster ID: cdb02bb198eb4a34a289bf0e4caf7a16
I20260808 08:53:02.055966 13751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:53:02.058604 13553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: No bootstrap required, opened a new log
I20260808 08:53:02.069940 13553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:02.070389 13553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437e795ea75742a683bce9172c3725be, State: Initialized, Role: FOLLOWER
I20260808 08:53:02.070921 13553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } }
I20260808 08:53:02.077960 13768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.080086 13768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:02.079962 13553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:53:02.081413 13503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:02.085093 13503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [term 1 FOLLOWER]: Refusing update from remote peer c63ac988054a4e7b957acaf83fcecd37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:53:02.085996 13722 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:53:02.088196 13505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c63ac988054a4e7b957acaf83fcecd37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "437e795ea75742a683bce9172c3725be"
I20260808 08:53:02.100262 13751 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:53:02.102396 13751 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:53:02.120760 13505 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c63ac988054a4e7b957acaf83fcecd37 for term 1 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260808 08:53:02.121485 13768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: SysCatalogTable state changed. Reason: New leader c63ac988054a4e7b957acaf83fcecd37. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.121780 13768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:02.121913 13731 sys_catalog.cc:455] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.122200 13731 sys_catalog.cc:458] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37 [sys.catalog]: This master's current role is: LEADER
I20260808 08:53:02.122968 13780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c63ac988054a4e7b957acaf83fcecd37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c63ac988054a4e7b957acaf83fcecd37" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 34245 } } peers { permanent_uuid: "437e795ea75742a683bce9172c3725be" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 46061 } } peers { permanent_uuid: "dcc3f11bc9e14d458bce52ea0539554e" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 44665 } } }
I20260808 08:53:02.123418 13780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:02.159593 13795 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:53:02.167104 13751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c63ac988054a4e7b957acaf83fcecd37: Generated new TSK 0
I20260808 08:53:02.168114 13751 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:53:02.255704 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.246567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56880 (local address 127.8.149.125:46061)
0808 08:53:02.246769 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.246777 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.248440 (+ 1663us) server_negotiation.cc:407] Connection header received
0808 08:53:02.254185 (+ 5745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.254190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.254320 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.254403 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.255490 (+ 1087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56880: BlockingRecv error: recv got EOF from 127.0.0.1:56880 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 08:53:02.256798 13685 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.248739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36432 (local address 127.8.149.124:44665)
0808 08:53:02.248942 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.248948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.254409 (+ 5461us) server_negotiation.cc:407] Connection header received
0808 08:53:02.255271 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.255277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.255357 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.255464 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.256482 (+ 1018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36432: BlockingRecv error: recv got EOF from 127.0.0.1:36432 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:53:02.260890 13421 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.246190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.8.149.126:34245)
0808 08:53:02.246416 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.246424 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.249000 (+ 2576us) server_negotiation.cc:407] Connection header received
0808 08:53:02.249316 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.249325 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.249423 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.249524 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.260662 (+ 11138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50562: BlockingRecv error: recv got EOF from 127.0.0.1:50562 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 08:53:02.288337 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.286119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56886 (local address 127.8.149.125:46061)
0808 08:53:02.286298 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.286306 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.286836 (+ 530us) server_negotiation.cc:407] Connection header received
0808 08:53:02.287048 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.287054 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.287170 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.287278 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.288065 (+ 787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56886: BlockingRecv error: recv got EOF from 127.0.0.1:56886 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 08:53:02.295799 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.293813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56890 (local address 127.8.149.125:46061)
0808 08:53:02.293978 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.293983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.294507 (+ 524us) server_negotiation.cc:407] Connection header received
0808 08:53:02.294686 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.294691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.294764 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.294852 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.295613 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56890: BlockingRecv error: recv got EOF from 127.0.0.1:56890 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 08:53:02.302784 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.300871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56892 (local address 127.8.149.125:46061)
0808 08:53:02.301006 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.301010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.301537 (+ 527us) server_negotiation.cc:407] Connection header received
0808 08:53:02.301704 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.301709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.301776 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.301868 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.302589 (+ 721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56892: BlockingRecv error: recv got EOF from 127.0.0.1:56892 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 08:53:02.311722 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.309903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.8.149.125:46061)
0808 08:53:02.310052 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.310057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.310516 (+ 459us) server_negotiation.cc:407] Connection header received
0808 08:53:02.310666 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.310671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.310747 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.310835 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.311517 (+ 682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56898: BlockingRecv error: recv got EOF from 127.0.0.1:56898 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 08:53:02.324820 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.322838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56910 (local address 127.8.149.125:46061)
0808 08:53:02.322993 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.323000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.323500 (+ 500us) server_negotiation.cc:407] Connection header received
0808 08:53:02.323669 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.323675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.323753 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.323847 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.324638 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56910: BlockingRecv error: recv got EOF from 127.0.0.1:56910 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 08:53:02.348577 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.346633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56922 (local address 127.8.149.125:46061)
0808 08:53:02.346784 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.346789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.347264 (+ 475us) server_negotiation.cc:407] Connection header received
0808 08:53:02.347406 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.347412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.347506 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.347615 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.348341 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56922: BlockingRecv error: recv got EOF from 127.0.0.1:56922 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 08:53:02.388484 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.386137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56926 (local address 127.8.149.125:46061)
0808 08:53:02.386352 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.386358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.386890 (+ 532us) server_negotiation.cc:407] Connection header received
0808 08:53:02.387113 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.387119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.387214 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.387326 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.388194 (+ 868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56926: BlockingRecv error: recv got EOF from 127.0.0.1:56926 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 08:53:02.458304 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.456359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.8.149.125:46061)
0808 08:53:02.456573 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.456581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.456924 (+ 343us) server_negotiation.cc:407] Connection header received
0808 08:53:02.457118 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.457126 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.457228 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.457346 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.458056 (+ 710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56930: BlockingRecv error: recv got EOF from 127.0.0.1:56930 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 08:53:02.593577 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.591670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56942 (local address 127.8.149.125:46061)
0808 08:53:02.591885 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.591893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.592292 (+ 399us) server_negotiation.cc:407] Connection header received
0808 08:53:02.592426 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.592430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.592526 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.592608 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.593284 (+ 676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56942: BlockingRecv error: recv got EOF from 127.0.0.1:56942 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 08:53:02.855659 13559 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:02.853911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56954 (local address 127.8.149.125:46061)
0808 08:53:02.854141 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:02.854147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:02.854360 (+ 213us) server_negotiation.cc:407] Connection header received
0808 08:53:02.854552 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:02.854557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:02.854626 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:02.854720 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:02.855465 (+ 745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56954: BlockingRecv error: recv got EOF from 127.0.0.1:56954 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 08:53:02.862838 13716 catalog_manager.cc:1259] Loaded cluster ID: cdb02bb198eb4a34a289bf0e4caf7a16
I20260808 08:53:02.862923 13716 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: loading cluster ID for follower catalog manager: success
I20260808 08:53:02.865203 13716 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: acquiring CA information for follower catalog manager: success
I20260808 08:53:02.866909 13716 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dcc3f11bc9e14d458bce52ea0539554e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:53:03.164324 13795 catalog_manager.cc:1259] Loaded cluster ID: cdb02bb198eb4a34a289bf0e4caf7a16
I20260808 08:53:03.164458 13795 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: loading cluster ID for follower catalog manager: success
I20260808 08:53:03.167398 13795 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: acquiring CA information for follower catalog manager: success
I20260808 08:53:03.169106 13795 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 437e795ea75742a683bce9172c3725be: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:53:03.380553 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:03.374036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56964 (local address 127.8.149.125:46061)
0808 08:53:03.374825 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:03.374829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:03.374848 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:53:03.374908 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:03.374912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:03.375040 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:03.375182 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:03.375634 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.376465 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.377732 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.378192 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.378326 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:03.378893 (+ 567us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:03.379679 (+ 786us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:03.379871 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:03.379935 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 08:53:03.380041 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":458,"threads_started":1}
I20260808 08:53:03.393579 13924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:03.386737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36434 (local address 127.8.149.124:44665)
0808 08:53:03.388399 (+ 1662us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:03.388404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:03.388419 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:53:03.388501 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:03.388505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:03.388638 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:03.388795 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:03.389214 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.389925 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.391379 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.391876 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.392009 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:03.392497 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:03.392959 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:03.393129 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:03.393225 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:53:03.393301 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1564,"thread_start_us":1483,"threads_started":1}
I20260808 08:53:03.419436 13924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:03.400571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36450 (local address 127.8.149.124:44665)
0808 08:53:03.405924 (+ 5353us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:03.405932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:03.412925 (+ 6993us) server_negotiation.cc:407] Connection header received
0808 08:53:03.413532 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:03.413541 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:03.413651 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:03.413736 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:03.414436 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.415538 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.417542 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.418056 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.418143 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:03.418728 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:03.418837 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:03.418891 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:03.419087 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 08:53:03.419166 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5200}
I20260808 08:53:03.419947 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:03.400414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56976 (local address 127.8.149.125:46061)
0808 08:53:03.405204 (+ 4790us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:03.405211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:03.412777 (+ 7566us) server_negotiation.cc:407] Connection header received
0808 08:53:03.413767 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:03.413774 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:03.413923 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:03.414049 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:03.414748 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.415814 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.417659 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.418273 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.418377 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:03.418980 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:03.419109 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:03.419176 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:03.419552 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 08:53:03.419641 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4633}
I20260808 08:53:03.422475 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:03.399884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50574 (local address 127.8.149.126:34245)
0808 08:53:03.414112 (+ 14228us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:03.414119 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:03.414142 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:53:03.414397 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:03.414405 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:03.414707 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:03.414910 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:03.415856 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.416938 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.419011 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:03.419922 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:03.420191 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:03.421283 (+ 1092us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:03.421772 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:03.421864 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:03.422103 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 08:53:03.422165 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14070,"thread_start_us":18655,"threads_started":1}
I20260808 08:53:03.427095 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13304
I20260808 08:53:03.428555 13406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:03.534008 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13304
I20260808 08:53:03.567126 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13425
I20260808 08:53:03.568399 13545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:03.671449 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13425
I20260808 08:53:03.697718 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13564
I20260808 08:53:03.698839 13676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:03.799130 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13564
2026-08-08T08:53:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5095 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:53:03 dist-test-slave-7vjv krb5kdc[13951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:53:03 dist-test-slave-7vjv krb5kdc[13951](info): set up 2 sockets
Aug 08 08:53:03 dist-test-slave-7vjv krb5kdc[13951](info): commencing operation
krb5kdc: starting...
W20260808 08:53:05.149381 8789 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.001s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/test-user.keytab.
Aug 08 08:53:05 dist-test-slave-7vjv krb5kdc[13951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:53:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:53:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.8.149.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
Entry for principal kudu/127.8.149.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab.
I20260808 08:53:05.431502 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40275
--webserver_interface=127.8.149.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:53:05.756019 13972 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:05.756383 13972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:05.756505 13972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:05.756657 13972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:05.763551 13972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:05.763662 13972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:05.763763 13972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:53:05.763854 13972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:05.763942 13972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:05.772841 13972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.126.keytab
--principal=kudu/127.8.149.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.126:40275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.149.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:05.774034 13972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:05.775265 13972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:53:05.787024 13980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:05.787084 13982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:05.787111 13984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:05.788000 13972 server_base.cc:1034] running on GCE node
I20260808 08:53:05.788820 13972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:05.790006 13972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:05.791226 13972 hybrid_clock.cc:648] HybridClock initialized: now 1786179185791155 us; error 31 us; skew 500 ppm
I20260808 08:53:05.791546 13972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:05 dist-test-slave-7vjv krb5kdc[13951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:05.797755 13972 init.cc:377] Logged in from keytab as kudu/127.8.149.126@KRBTEST.COM (short username kudu)
I20260808 08:53:05.799118 13972 webserver.cc:460] Webserver started at http://127.8.149.126:43731/ using document root <none> and password file <none>
I20260808 08:53:05.799777 13972 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:05.799903 13972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:05.800275 13972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:05.803045 13972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data/instance:
uuid: "7618a777b40a48df9454f6315e6f1fa8"
format_stamp: "Formatted at 2026-08-08 08:53:05 on dist-test-slave-7vjv"
server_key: "6b36aad53d9d5a8eb77100b0fa55e7c1"
server_key_iv: "5ebbb59be46c4d9c16eaf3b29b476034"
server_key_version: "encryptionkey@0"
I20260808 08:53:05.803793 13972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance:
uuid: "7618a777b40a48df9454f6315e6f1fa8"
format_stamp: "Formatted at 2026-08-08 08:53:05 on dist-test-slave-7vjv"
server_key: "6b36aad53d9d5a8eb77100b0fa55e7c1"
server_key_iv: "5ebbb59be46c4d9c16eaf3b29b476034"
server_key_version: "encryptionkey@0"
I20260808 08:53:05.808881 13972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:53:05.811956 13994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:05.813154 13972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:53:05.813349 13972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal
uuid: "7618a777b40a48df9454f6315e6f1fa8"
format_stamp: "Formatted at 2026-08-08 08:53:05 on dist-test-slave-7vjv"
server_key: "6b36aad53d9d5a8eb77100b0fa55e7c1"
server_key_iv: "5ebbb59be46c4d9c16eaf3b29b476034"
server_key_version: "encryptionkey@0"
I20260808 08:53:05.813570 13972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:05.829751 13972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:05.833241 13972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:05.833495 13972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:05.851514 13972 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.126:40275
I20260808 08:53:05.851545 14095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.126:40275 every 8 connection(s)
I20260808 08:53:05.852916 13972 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/data/info.pb
I20260808 08:53:05.856320 14096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:05.856712 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 13972
I20260808 08:53:05.856911 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-0/wal/instance
I20260808 08:53:05.857497 8789 external_mini_cluster.cc:1428] Setting key 411c80ff17b770a49d5b2a9ad07fcdeb
I20260808 08:53:05.865477 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:05 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:05.887871 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.868757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40275 (local address 127.0.0.1:46226)
0808 08:53:05.869497 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:05.869543 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:05.871352 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:05.872211 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:05.872215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:05.873006 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:05.873517 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:05.873545 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:05.874960 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:05.874968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:05.876745 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:05.876767 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:05.877603 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:05.877612 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:05.877828 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:05.878442 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:05.878482 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:05.881143 (+ 2661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:05.884003 (+ 2860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:05.884015 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:05.884025 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:05.884424 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:05.884780 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:05.884785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:05.884788 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:05.884923 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:05.885556 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:05.885568 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:05.885771 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 08:53:05.885987 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 08:53:05.886660 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":193,"thread_start_us":315,"threads_started":1}
I20260808 08:53:05.887894 14099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.869883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46226 (local address 127.8.149.126:40275)
0808 08:53:05.870533 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:05.870543 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:05.870588 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:53:05.871692 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:05.871701 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:05.871961 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:05.872184 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:05.873749 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:05.874814 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:05.876875 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:05.877378 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:05.877518 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:05.881339 (+ 3821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:05.881346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:05.881356 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:05.881386 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:05.883872 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:05.884546 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:05.884552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:05.884554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:05.884680 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:05.885032 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:05.885036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:05.885043 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:05.885427 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:05.885636 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:05.886108 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 08:53:05.886516 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":435,"thread_start_us":276,"threads_started":1}
WARNING: no policy specified for kudu/127.8.149.125@KRBTEST.COM; defaulting to no policy
I20260808 08:53:05.890905 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:05.891999 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.891613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42416)
0808 08:53:05.891759 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:05.891885 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:53:05.892292 13996 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.125@KRBTEST.COM" created.
I20260808 08:53:05.893816 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.893468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42430)
0808 08:53:05.893595 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:05.893658 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 08:53:05.894234 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:36139: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
Entry for principal kudu/127.8.149.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab.
I20260808 08:53:05.925659 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:36139
--webserver_interface=127.8.149.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:53:05.943590 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } attempt: 1
I20260808 08:53:05.944916 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.944308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42436)
0808 08:53:05.944564 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:05.944731 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:53:05.945995 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:05.945551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42450)
0808 08:53:05.945734 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:05.945829 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:53:05.946242 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:36139: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
I20260808 08:53:06.014504 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } attempt: 2
I20260808 08:53:06.015779 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.015229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42456)
0808 08:53:06.015487 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.015605 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:53:06.016801 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.016414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42458)
0808 08:53:06.016580 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.016658 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 08:53:06.016984 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:36139: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
I20260808 08:53:06.108326 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } attempt: 3
I20260808 08:53:06.109838 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.109220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42460)
0808 08:53:06.109512 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.109645 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:53:06.111014 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.110567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42476)
0808 08:53:06.110739 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.110828 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 08:53:06.111290 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:36139: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
I20260808 08:53:06.254590 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } attempt: 4
I20260808 08:53:06.255985 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.255303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42482)
0808 08:53:06.255682 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.255805 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260808 08:53:06.257236 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.256794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42494)
0808 08:53:06.256961 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.257069 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:53:06.257462 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.125:36139: Network error: Client connection negotiation failed: client connection to 127.8.149.125:36139: connect: Connection refused (error 111)
W20260808 08:53:06.269788 14105 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:06.270076 14105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:06.270149 14105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:06.270229 14105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:06.277393 14105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:06.277479 14105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:06.277547 14105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:53:06.277606 14105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:06.277676 14105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:06.287490 14105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.125.keytab
--principal=kudu/127.8.149.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.125:36139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.149.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:06.288827 14105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:06.290241 14105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:53:06.302000 14120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:06.302052 14117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:06.302080 14118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:06.302758 14105 server_base.cc:1034] running on GCE node
I20260808 08:53:06.303577 14105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:06.304977 14105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:06.306231 14105 hybrid_clock.cc:648] HybridClock initialized: now 1786179186306167 us; error 49 us; skew 500 ppm
I20260808 08:53:06.306615 14105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:06.309809 14105 init.cc:377] Logged in from keytab as kudu/127.8.149.125@KRBTEST.COM (short username kudu)
I20260808 08:53:06.311187 14105 webserver.cc:460] Webserver started at http://127.8.149.125:35855/ using document root <none> and password file <none>
I20260808 08:53:06.311815 14105 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:06.311950 14105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:06.312404 14105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:06.315128 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data/instance:
uuid: "603a4d63a19d4e878543233bb32d4923"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "d8ad76cdfe02438946f38158b35bb1cb"
server_key_iv: "dc8efcaec228b94415a44d318ebe7951"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.315882 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal/instance:
uuid: "603a4d63a19d4e878543233bb32d4923"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "d8ad76cdfe02438946f38158b35bb1cb"
server_key_iv: "dc8efcaec228b94415a44d318ebe7951"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.320817 14105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260808 08:53:06.323719 14130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:06.325049 14105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:53:06.325213 14105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal
uuid: "603a4d63a19d4e878543233bb32d4923"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "d8ad76cdfe02438946f38158b35bb1cb"
server_key_iv: "dc8efcaec228b94415a44d318ebe7951"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.325424 14105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:06.358174 14105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:06.364143 14105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:06.364444 14105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:06.385000 14105 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.125:36139
I20260808 08:53:06.384979 14216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.125:36139 every 8 connection(s)
I20260808 08:53:06.386322 14105 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/data/info.pb
I20260808 08:53:06.390192 14220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:06.395053 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14105
I20260808 08:53:06.395267 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-1/wal/instance
I20260808 08:53:06.395812 8789 external_mini_cluster.cc:1428] Setting key f2875ce7d42869a36cd9ab7299719be1
I20260808 08:53:06.397161 14220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:06.421998 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.400389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46238 (local address 127.8.149.126:40275)
0808 08:53:06.400868 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.400875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.401837 (+ 962us) server_negotiation.cc:407] Connection header received
0808 08:53:06.404575 (+ 2738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.404579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.404647 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.404743 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.406954 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.407650 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.410031 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.410469 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.410557 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.414684 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.414693 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.414701 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.414760 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.418644 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.419352 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.419360 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.419366 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.419504 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.419966 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.419973 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.419979 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.420455 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.420600 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.421281 (+ 681us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.421521 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":218,"threads_started":1}
I20260808 08:53:06.422576 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.400914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40275 (local address 127.0.0.1:46238)
0808 08:53:06.401667 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.401713 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.404282 (+ 2569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.405062 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.405076 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.405976 (+ 900us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.406737 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.406764 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.407830 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.407839 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.409879 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.409899 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.410702 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.410711 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.411045 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.411788 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.411829 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.414451 (+ 2622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.418774 (+ 4323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.418780 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.418789 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.419219 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.419619 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.419622 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.419624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.419819 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.420592 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.420598 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.420931 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.421153 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.421468 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":277,"threads_started":1}
I20260808 08:53:06.424369 14220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.8.149.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.8.149.124@KRBTEST.COM" created.
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:06.441458 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.425175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42508)
0808 08:53:06.425349 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.425375 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.425503 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.426205 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.426209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.426616 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.426740 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.426749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.428213 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.428220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.429152 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.429164 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.430184 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.430191 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.430388 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.431011 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.431030 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.434377 (+ 3347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.438942 (+ 4565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.438946 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.438948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.439339 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.439788 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.439791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.439793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.439936 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.440708 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.440712 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.440828 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.440966 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.441169 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:53:06.441929 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.425266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42508 (local address 127.8.149.125:36139)
0808 08:53:06.425829 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.425835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.425861 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:53:06.425901 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.425906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.426067 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.426211 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.426913 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.428053 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.429284 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.429991 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.430170 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.434640 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.434658 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.434678 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.434728 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.438786 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.439489 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.439500 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.439506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.439673 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.440054 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.440061 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.440067 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.440568 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.440786 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.441144 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.441426 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":276,"threads_started":1}
I20260808 08:53:06.444459 14220 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:06.445689 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.445202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38316)
0808 08:53:06.445405 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.445543 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:53:06.445969 14134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.447669 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.447306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38318)
0808 08:53:06.447489 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.447569 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260808 08:53:06.447966 14220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
Entry for principal kudu/127.8.149.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab.
I20260808 08:53:06.471455 8789 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
/tmp/dist-test-task4pJ3L_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:41443
--webserver_interface=127.8.149.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.8.149.84:42893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:53:06.497326 14220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 1
I20260808 08:53:06.498435 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.498027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38332)
0808 08:53:06.498205 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.498299 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:53:06.499490 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.499116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38342)
0808 08:53:06.499309 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.499384 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 08:53:06.499722 14220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.556778 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } attempt: 5
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:06.567922 14220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 2
I20260808 08:53:06.568912 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.568472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38354)
0808 08:53:06.568653 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.568742 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 08:53:06.569962 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.569576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38358)
0808 08:53:06.569736 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.569814 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260808 08:53:06.570225 14220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.571147 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.557661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.8.149.125:36139)
0808 08:53:06.557822 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.557828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.557853 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:53:06.558045 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.558051 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.558149 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.558262 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.559012 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.560141 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.561181 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.561821 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.561934 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.565041 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.565049 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.565055 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.565099 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.568329 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.569035 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.569040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.569043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.569209 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.569650 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.569655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.569658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.569966 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.570128 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.570610 (+ 482us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.570838 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:53:06.571189 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.557584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42516)
0808 08:53:06.557771 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.557794 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.557914 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.558309 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.558312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.558682 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.558856 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.558864 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.560255 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.560259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.561031 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.561043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.561954 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.561957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.562118 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.562713 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.562728 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.564858 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.568480 (+ 3622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.568485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.568488 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.568875 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.569346 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.569351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.569354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.569530 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.570193 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.570199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.570368 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.570504 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.570819 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 08:53:06.572155 14096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:53:06.573235 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.572885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38370)
0808 08:53:06.573034 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.573114 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:53:06.574147 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.573854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38374)
0808 08:53:06.573984 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.574066 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:53:06.574353 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.625559 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 1
I20260808 08:53:06.626785 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.626189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38384)
0808 08:53:06.626416 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.626542 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:53:06.628125 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.627634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38400)
0808 08:53:06.627825 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.627929 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 08:53:06.628436 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.661499 14220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 3
I20260808 08:53:06.662907 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.662245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38402)
0808 08:53:06.662535 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.662674 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 08:53:06.664291 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.663611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38416)
0808 08:53:06.663882 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.663995 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
W20260808 08:53:06.664605 14220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.696708 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 2
I20260808 08:53:06.698071 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.697481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38420)
0808 08:53:06.697744 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.697868 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:53:06.699231 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.698797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38422)
0808 08:53:06.698973 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.699075 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:53:06.699496 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
W20260808 08:53:06.798594 14236 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:53:06.798863 14236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:53:06.798941 14236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:53:06.799017 14236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:53:06.805619 14236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:53:06.805742 14236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:53:06.805847 14236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260808 08:53:06.805732 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 3
W20260808 08:53:06.805976 14236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:53:06.806073 14236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:53:06.806963 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.806459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38436)
0808 08:53:06.806677 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.806780 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:53:06.807965 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.807550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38440)
0808 08:53:06.807738 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.807820 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 08:53:06.807929 14220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 4
W20260808 08:53:06.808256 14096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.808949 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.808469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38456)
0808 08:53:06.808692 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.808785 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 08:53:06.809911 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.809546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38460)
0808 08:53:06.809712 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.809793 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 08:53:06.810155 14220 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.149.124:41443: Network error: Client connection negotiation failed: client connection to 127.8.149.124:41443: connect: Connection refused (error 111)
I20260808 08:53:06.815989 14236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.149.84:42893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.8.149.126:40275,127.8.149.125:36139,127.8.149.124:41443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/krb5kdc/kudu_127.8.149.124.keytab
--principal=kudu/127.8.149.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.149.124:41443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.149.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:53:06.817171 14236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:53:06.818482 14236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:53:06.829810 14246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:06.829981 14244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:53:06.830097 14248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:53:06.830960 14236 server_base.cc:1034] running on GCE node
I20260808 08:53:06.831643 14236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:53:06.832899 14236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:53:06.834137 14236 hybrid_clock.cc:648] HybridClock initialized: now 1786179186834072 us; error 32 us; skew 500 ppm
I20260808 08:53:06.834406 14236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:53:06.837565 14236 init.cc:377] Logged in from keytab as kudu/127.8.149.124@KRBTEST.COM (short username kudu)
I20260808 08:53:06.838920 14236 webserver.cc:460] Webserver started at http://127.8.149.124:41473/ using document root <none> and password file <none>
I20260808 08:53:06.839514 14236 fs_manager.cc:359] Metadata directory not provided
I20260808 08:53:06.839613 14236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:53:06.839876 14236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:53:06.842764 14236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data/instance:
uuid: "72bf44330e4b40c6baa5c6313c49dc54"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "1b66246626c796dd6a23d66f052f611c"
server_key_iv: "9c8453ce3100f41af84df45b7db14218"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.843466 14236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal/instance:
uuid: "72bf44330e4b40c6baa5c6313c49dc54"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "1b66246626c796dd6a23d66f052f611c"
server_key_iv: "9c8453ce3100f41af84df45b7db14218"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.848209 14236 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260808 08:53:06.851405 14263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:53:06.852829 14236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:53:06.852994 14236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data,/tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal
uuid: "72bf44330e4b40c6baa5c6313c49dc54"
format_stamp: "Formatted at 2026-08-08 08:53:06 on dist-test-slave-7vjv"
server_key: "1b66246626c796dd6a23d66f052f611c"
server_key_iv: "9c8453ce3100f41af84df45b7db14218"
server_key_version: "encryptionkey@0"
I20260808 08:53:06.853183 14236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:53:06.874966 14236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:53:06.878500 14236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:53:06.878696 14236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:53:06.896782 14236 rpc_server.cc:307] RPC server started. Bound to: 127.8.149.124:41443
I20260808 08:53:06.896800 14343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.149.124:41443 every 8 connection(s)
I20260808 08:53:06.898093 14236 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/data/info.pb
I20260808 08:53:06.900462 8789 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu as pid 14236
I20260808 08:53:06.900637 8789 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4pJ3L_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178813799529-8789-0/minicluster-data/master-2/wal/instance
I20260808 08:53:06.901111 8789 external_mini_cluster.cc:1428] Setting key 314c0e4c0cedbcf74009fc452f054b36
I20260808 08:53:06.901763 14345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:53:06.911337 14345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
I20260808 08:53:06.924310 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.902831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38462 (local address 127.8.149.124:41443)
0808 08:53:06.903689 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.903706 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.903755 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:53:06.905410 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.905437 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.905943 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.906371 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.907663 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.909614 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.910816 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.911827 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.912019 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.916363 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.916370 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.916379 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.916410 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.919900 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.920738 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.920746 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.920753 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.920949 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.921310 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.921315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.921317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.921907 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.922120 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.922650 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.923034 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":380,"threads_started":1}
I20260808 08:53:06.928946 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.913939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46250 (local address 127.8.149.126:40275)
0808 08:53:06.914166 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.914175 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.914733 (+ 558us) server_negotiation.cc:407] Connection header received
0808 08:53:06.914879 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.914884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.914971 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.915090 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.916160 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.916930 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.919093 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.919518 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.919626 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.923101 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.923108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.923112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.923147 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.926064 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.926824 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.926828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.926829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.927029 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.927490 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.927495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.927497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.927838 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.927971 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.928513 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.928677 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:53:06.929098 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.913886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.126:40275 (local address 127.0.0.1:46250)
0808 08:53:06.914592 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.914643 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.914767 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.915133 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.915137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.915741 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.915978 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.915987 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.917106 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.917112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.918878 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.918894 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.919735 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.919744 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.919926 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.920584 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.920599 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.922923 (+ 2324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.926196 (+ 3273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.926203 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.926207 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.926683 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.927170 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.927176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.927179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.927359 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.927950 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.927956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.928167 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.928394 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.928710 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":336,"threads_started":1}
I20260808 08:53:06.930409 14345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.126@KRBTEST.COM
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
I20260808 08:53:06.942898 14353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.927035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.8.149.126:40275)
0808 08:53:06.927623 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.927628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.927658 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:53:06.927694 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.927697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.927747 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.927860 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.929395 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.930288 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.931674 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.932082 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.932227 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.936967 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.936972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.936975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.937002 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.940272 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.940997 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.941002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.941005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.941159 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.941522 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.941526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.941529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.941884 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.942178 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.942374 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.942589 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":242,"threads_started":1}
I20260808 08:53:06.945604 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.930997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.125:36139 (local address 127.0.0.1:42524)
0808 08:53:06.931130 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.931147 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.931232 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.931544 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.931549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.931895 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.932029 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.932036 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.933379 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.933384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.934622 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.934638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.936029 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.936036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.936222 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.936722 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.936737 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.938789 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.942761 (+ 3972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.942781 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.942784 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.943236 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.943586 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.943592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.943595 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.943803 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.944356 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.944360 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.944931 (+ 571us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.945072 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.945305 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 08:53:06.945761 14233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.931089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42524 (local address 127.8.149.125:36139)
0808 08:53:06.931251 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.931258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.931278 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:53:06.931334 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.931338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.931406 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.931508 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.932227 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.933196 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.934859 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.935710 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.935842 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.938991 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.938997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.939003 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.939047 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.942495 (+ 3448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.943357 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.943360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.943362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.943484 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.943919 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.943924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.943928 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.944236 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.944388 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.945171 (+ 783us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.945389 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:53:06.946579 14345 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.8.149.125@KRBTEST.COM
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.124@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:53:06.958683 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.944469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42528 (local address 127.8.149.125:36139)
0808 08:53:06.944976 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.944979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.944997 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:53:06.945030 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.945033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.945077 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.945190 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.946701 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.947611 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.948932 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.949338 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.949484 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.953407 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.953413 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.953417 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.953447 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.956065 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.956731 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.956737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.956740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.956859 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.957240 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.957245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.957248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.957531 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.957810 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.958079 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.958280 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":222,"threads_started":1}
I20260808 08:53:06.958712 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.947321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38476 (local address 127.8.149.124:41443)
0808 08:53:06.947487 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.947494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.947635 (+ 141us) server_negotiation.cc:407] Connection header received
0808 08:53:06.947783 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.947788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.947845 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.947933 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.948607 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.949238 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.950325 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.950736 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.950846 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.953608 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.953612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.953614 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.953639 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.956181 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.956769 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.956774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.956777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.956895 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:06.957237 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:06.957242 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:06.957245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:06.957520 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:06.957672 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:06.958005 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 08:53:06.958373 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":52}
I20260808 08:53:06.958734 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.947338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38476)
0808 08:53:06.947551 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.947566 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.947680 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.947947 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.947950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.948359 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.948472 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.948480 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.949376 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.949382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.950199 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.950209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.950881 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.950886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.951061 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.951515 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.951528 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.953450 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.956306 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.956313 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.956317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.956646 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.957020 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.957023 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.957025 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:06.957132 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:06.957650 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:06.957654 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:06.957791 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 08:53:06.957930 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 08:53:06.958215 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260808 08:53:06.963198 8789 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:53:06.964263 14345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: Bootstrap starting.
I20260808 08:53:06.967278 14345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:06.965453 14045 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7618a777b40a48df9454f6315e6f1fa8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46252
I20260808 08:53:06.968405 14345 log.cc:824] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:06.970851 14345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: No bootstrap required, opened a new log
I20260808 08:53:06.977440 14345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:06.977763 14345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bf44330e4b40c6baa5c6313c49dc54, State: Initialized, Role: FOLLOWER
I20260808 08:53:06.978180 14345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:06.979084 14357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:06.979502 14357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:06.979960 14345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:53:06.985455 14096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 4
W20260808 08:53:06.989336 14375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:53:06.989455 14375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 08 08:53:06 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179185, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.126@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
I20260808 08:53:06.987316 14236 master_runner.cc:186] Error getting master registration for 127.8.149.126:40275: OK, instance_id { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" instance_seqno: 1786179185846407 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:53:06.996974 14236 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:53:07.002430 14098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.985993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38492)
0808 08:53:06.986251 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:06.986271 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:06.986380 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:06.986929 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:06.986934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:06.987440 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:06.987612 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.987623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.989216 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.989224 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.990653 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:06.990669 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.992041 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.992048 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:06.992274 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.992933 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:06.992956 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:06.995548 (+ 2592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:06.999660 (+ 4112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:06.999667 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:06.999673 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:07.000169 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:07.000566 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:07.000571 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:07.000575 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:07.000742 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:07.001400 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:07.001405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:07.001569 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 08:53:07.001712 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 08:53:07.001971 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260808 08:53:07.002476 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:06.986295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38492 (local address 127.8.149.124:41443)
0808 08:53:06.986477 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:06.986482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:06.986499 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:53:06.986552 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:06.986558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:06.986634 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:06.986757 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:06.987777 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.989027 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.990838 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:06.991639 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:06.991790 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:06.995773 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:06.995779 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:06.995784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:06.995823 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:06.999484 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.000294 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.000300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.000304 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.000454 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.000861 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.000868 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.000871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.001237 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:07.001448 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:07.001840 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:53:07.002050 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:53:07.008436 14096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: Bootstrap starting.
I20260808 08:53:07.012425 14096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:07.013631 14096 log.cc:824] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:07.016956 14096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: No bootstrap required, opened a new log
I20260808 08:53:07.024472 14096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.024885 14096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7618a777b40a48df9454f6315e6f1fa8, State: Initialized, Role: FOLLOWER
I20260808 08:53:07.025393 14096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.026402 14382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.026968 14382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.027732 14096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:53:07.027776 14045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:53:07.028018 14045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:07.030821 14045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.032181 14045 leader_election.cc:288] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [CANDIDATE]: Term 1 election: Requested vote from peers 603a4d63a19d4e878543233bb32d4923 (127.8.149.125:36139), 72bf44330e4b40c6baa5c6313c49dc54 (127.8.149.124:41443)
I20260808 08:53:07.032768 14303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7618a777b40a48df9454f6315e6f1fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "72bf44330e4b40c6baa5c6313c49dc54"
I20260808 08:53:07.033214 14303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:07.036783 14303 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7618a777b40a48df9454f6315e6f1fa8 in term 1.
I20260808 08:53:07.037431 14003 leader_election.cc:302] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bf44330e4b40c6baa5c6313c49dc54, 7618a777b40a48df9454f6315e6f1fa8; no voters:
I20260808 08:53:07.037858 14382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:53:07.050783 14382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 7618a777b40a48df9454f6315e6f1fa8, State: Running, Role: LEADER
I20260808 08:53:07.051410 14382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.060626 14395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7618a777b40a48df9454f6315e6f1fa8. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.061050 14395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:53:07.069329 14407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:53:07.083990 14407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 08:53:07.086865 14007 tablet.cc:2369] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:53:07.089751 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:07.053547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42530 (local address 127.8.149.125:36139)
0808 08:53:07.053747 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.053755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.054802 (+ 1047us) server_negotiation.cc:407] Connection header received
0808 08:53:07.055776 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.055783 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.055894 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.055970 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.063571 (+ 7601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.064636 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.068750 (+ 4114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.069638 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.069774 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:07.076669 (+ 6895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:07.076676 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:07.076680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:07.076749 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:07.082516 (+ 5767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.084357 (+ 1841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.084366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.084372 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.084684 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.085600 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.085634 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.085640 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.086365 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:07.086800 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:07.088045 (+ 1245us) server_negotiation.cc:299] Negotiation successful
0808 08:53:07.088595 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:53:07.093302 14353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:07.047142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.8.149.126:40275)
0808 08:53:07.047332 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.047338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.052656 (+ 5318us) server_negotiation.cc:407] Connection header received
0808 08:53:07.053037 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.053043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.053117 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.053185 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.060226 (+ 7041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.061383 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.063896 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.064588 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.064696 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:07.082637 (+ 17941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:07.082646 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:07.082652 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:07.082695 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:07.086560 (+ 3865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.088408 (+ 1848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.088413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.088417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.088588 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.089676 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.089683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.089687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.090071 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:07.090311 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:07.092340 (+ 2029us) server_negotiation.cc:299] Negotiation successful
0808 08:53:07.092801 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:53:07.106138 14303 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [term 1 FOLLOWER]: Refusing update from remote peer 7618a777b40a48df9454f6315e6f1fa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:53:07.107146 14395 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:53:07.109033 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:07.055672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38508 (local address 127.8.149.124:41443)
0808 08:53:07.055884 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.055892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.063788 (+ 7896us) server_negotiation.cc:407] Connection header received
0808 08:53:07.066140 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.066149 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.066270 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.066357 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.079736 (+ 13379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.080881 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.090793 (+ 9912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.091538 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.091643 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:07.098009 (+ 6366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:07.098016 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:07.098020 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:07.098063 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:07.103070 (+ 5007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.103888 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.103896 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.103902 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.104231 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.104747 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.104754 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.104757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.105127 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:07.105417 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:07.107181 (+ 1764us) server_negotiation.cc:299] Negotiation successful
0808 08:53:07.107904 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:53:07.109344 14220 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } attempt: 5
Aug 08 08:53:07 dist-test-slave-7vjv krb5kdc[13951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786179186, etypes {rep=17 tkt=17 ses=17}, kudu/127.8.149.125@KRBTEST.COM for kudu/127.8.149.124@KRBTEST.COM
W20260808 08:53:07.130735 14271 tablet.cc:2369] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:53:07.133836 14357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7618a777b40a48df9454f6315e6f1fa8. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.134155 14357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.135076 14412 mvcc.cc:205] Tried to move back new op lower bound from 7316189950347452416 to 7316189950168666112. Current Snapshot: MvccSnapshot[applied={T|T < 7316189950347452416}]
I20260808 08:53:07.135946 14395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.136246 14395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: This master's current role is: LEADER
I20260808 08:53:07.137519 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:07.109861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.149.124:41443 (local address 127.0.0.1:38524)
0808 08:53:07.110203 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 08:53:07.110224 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:53:07.110333 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:53:07.111568 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:53:07.111576 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:53:07.112265 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:53:07.112527 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:07.112542 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.115834 (+ 3292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.115843 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:07.117527 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:53:07.117546 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.120128 (+ 2582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.120137 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:53:07.120447 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:07.121257 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:53:07.121287 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:53:07.124420 (+ 3133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:53:07.134627 (+ 10207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:07.134633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:07.134636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:07.135154 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:07.135745 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:53:07.135750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:53:07.135753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:53:07.135920 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:53:07.136581 (+ 661us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:53:07.136586 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:53:07.136738 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 08:53:07.136872 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:53:07.137147 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208}
I20260808 08:53:07.138813 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:07.110546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38524 (local address 127.8.149.124:41443)
0808 08:53:07.110876 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.110916 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.110945 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:53:07.111086 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.111133 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.111295 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.112762 (+ 1467us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.113112 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.115584 (+ 2472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.118091 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:07.119790 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:07.123136 (+ 3346us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:07.124734 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:53:07.124746 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:53:07.124755 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:53:07.124872 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:53:07.134475 (+ 9603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.135336 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.135343 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.135349 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.135593 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:53:07.136067 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:53:07.136071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:53:07.136074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:53:07.136445 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:53:07.138052 (+ 1607us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:07.138170 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 08:53:07.138416 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:53:07.143862 14415 mvcc.cc:205] Tried to move back new op lower bound from 7316189950347452416 to 7316189950168666112. Current Snapshot: MvccSnapshot[applied={T|T < 7316189950347452416}]
I20260808 08:53:07.144263 14220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: Bootstrap starting.
I20260808 08:53:07.147420 14357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.147665 14357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.148149 14220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: Neither blocks nor log segments found. Creating new log.
I20260808 08:53:07.149426 14220 log.cc:824] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: Log is configured to *not* fsync() on all Append() calls
I20260808 08:53:07.138932 13972 master_runner.cc:186] Error getting master registration for 127.8.149.125:36139: OK, instance_id { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" instance_seqno: 1786179186379659 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:53:07.166705 14407 catalog_manager.cc:1347] Generated new cluster ID: a83a8077a5e44743bda62555d83a765c
I20260808 08:53:07.166837 14407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:53:07.166893 13972 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:53:07.178529 14220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: No bootstrap required, opened a new log
I20260808 08:53:07.205533 14407 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:53:07.207453 14407 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:53:07.208406 14220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.209163 14220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 603a4d63a19d4e878543233bb32d4923, State: Initialized, Role: FOLLOWER
I20260808 08:53:07.210114 14220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } }
I20260808 08:53:07.220662 14407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8: Generated new TSK 0
I20260808 08:53:07.221603 14407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:53:07.223354 14428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.223835 14428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.225092 14220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:53:07.225495 14168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:53:07.228781 14170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7618a777b40a48df9454f6315e6f1fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "603a4d63a19d4e878543233bb32d4923"
I20260808 08:53:07.230342 14168 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [term 1 FOLLOWER]: Refusing update from remote peer 7618a777b40a48df9454f6315e6f1fa8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:53:07.233659 14170 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7618a777b40a48df9454f6315e6f1fa8 in term 1.
I20260808 08:53:07.235793 14382 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:53:07.284816 14428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7618a777b40a48df9454f6315e6f1fa8. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.285168 14428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.284857 14439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.285291 14439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:53:07.334033 14460 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260808 08:53:07.351588 14353 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.348393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46278 (local address 127.8.149.126:40275)
0808 08:53:07.348625 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.348631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.349395 (+ 764us) server_negotiation.cc:407] Connection header received
0808 08:53:07.349706 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.349713 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.349787 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.349851 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.351294 (+ 1443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46278: BlockingRecv error: recv got EOF from 127.0.0.1:46278 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260808 08:53:07.353721 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.349477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.8.149.125:36139)
0808 08:53:07.349651 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.349657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.352183 (+ 2526us) server_negotiation.cc:407] Connection header received
0808 08:53:07.352397 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.352402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.352467 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.352535 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.353490 (+ 955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42534: BlockingRecv error: recv got EOF from 127.0.0.1:42534 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 08:53:07.355512 14351 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.351878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.8.149.124:41443)
0808 08:53:07.352033 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.352038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.354147 (+ 2109us) server_negotiation.cc:407] Connection header received
0808 08:53:07.354334 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.354338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.354413 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.354472 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.355268 (+ 796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38528: BlockingRecv error: recv got EOF from 127.0.0.1:38528 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 08:53:07.361581 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.359672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.8.149.125:36139)
0808 08:53:07.359807 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.359811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.360234 (+ 423us) server_negotiation.cc:407] Connection header received
0808 08:53:07.360431 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.360435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.360553 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.360655 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.361391 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42548: BlockingRecv error: recv got EOF from 127.0.0.1:42548 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 08:53:07.372174 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.370228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42550 (local address 127.8.149.125:36139)
0808 08:53:07.370386 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.370392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.370864 (+ 472us) server_negotiation.cc:407] Connection header received
0808 08:53:07.371063 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.371068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.371144 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.371250 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.371922 (+ 672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42550: BlockingRecv error: recv got EOF from 127.0.0.1:42550 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 08:53:07.393191 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.377652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42552 (local address 127.8.149.125:36139)
0808 08:53:07.377782 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.377787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.388532 (+ 10745us) server_negotiation.cc:407] Connection header received
0808 08:53:07.388730 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.388736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.388834 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.388930 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.392959 (+ 4029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42552: BlockingRecv error: recv got EOF from 127.0.0.1:42552 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 08:53:07.419234 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.416722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42566 (local address 127.8.149.125:36139)
0808 08:53:07.417026 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.417032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.417583 (+ 551us) server_negotiation.cc:407] Connection header received
0808 08:53:07.417790 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.417796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.417904 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.418043 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.419012 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42566: BlockingRecv error: recv got EOF from 127.0.0.1:42566 (error 108)
Metrics: {"server-negotiator.queue_time_us":175}
W20260808 08:53:07.436369 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.434070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42578 (local address 127.8.149.125:36139)
0808 08:53:07.434264 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.434270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.434858 (+ 588us) server_negotiation.cc:407] Connection header received
0808 08:53:07.435067 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.435073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.435169 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.435295 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.436177 (+ 882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42578: BlockingRecv error: recv got EOF from 127.0.0.1:42578 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 08:53:07.459060 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.456285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.8.149.125:36139)
0808 08:53:07.456502 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.456509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.457213 (+ 704us) server_negotiation.cc:407] Connection header received
0808 08:53:07.457508 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.457516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.457612 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.457721 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.458741 (+ 1020us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42588: BlockingRecv error: recv got EOF from 127.0.0.1:42588 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 08:53:07.501361 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.498921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42592 (local address 127.8.149.125:36139)
0808 08:53:07.499124 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.499131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.499798 (+ 667us) server_negotiation.cc:407] Connection header received
0808 08:53:07.500033 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.500039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.500154 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.500270 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.501134 (+ 864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42592: BlockingRecv error: recv got EOF from 127.0.0.1:42592 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 08:53:07.571745 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.569587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42606 (local address 127.8.149.125:36139)
0808 08:53:07.569811 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.569817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.570207 (+ 390us) server_negotiation.cc:407] Connection header received
0808 08:53:07.570419 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.570423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.570492 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.570577 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.571507 (+ 930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42606: BlockingRecv error: recv got EOF from 127.0.0.1:42606 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 08:53:07.705632 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.703443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.8.149.125:36139)
0808 08:53:07.703714 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.703720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.704115 (+ 395us) server_negotiation.cc:407] Connection header received
0808 08:53:07.704343 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.704348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.704469 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.704583 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.705391 (+ 808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42612: BlockingRecv error: recv got EOF from 127.0.0.1:42612 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
I20260808 08:53:07.744417 14382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7618a777b40a48df9454f6315e6f1fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7618a777b40a48df9454f6315e6f1fa8" member_type: VOTER last_known_addr { host: "127.8.149.126" port: 40275 } } peers { permanent_uuid: "603a4d63a19d4e878543233bb32d4923" member_type: VOTER last_known_addr { host: "127.8.149.125" port: 36139 } } peers { permanent_uuid: "72bf44330e4b40c6baa5c6313c49dc54" member_type: VOTER last_known_addr { host: "127.8.149.124" port: 41443 } } }
I20260808 08:53:07.744774 14382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7618a777b40a48df9454f6315e6f1fa8 [sys.catalog]: This master's current role is: LEADER
W20260808 08:53:07.971489 14355 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:53:07.969764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42622 (local address 127.8.149.125:36139)
0808 08:53:07.969992 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:07.969999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:07.970123 (+ 124us) server_negotiation.cc:407] Connection header received
0808 08:53:07.970302 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:07.970306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:07.970385 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:07.970484 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:53:07.971246 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42622: BlockingRecv error: recv got EOF from 127.0.0.1:42622 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:53:07.991549 14375 catalog_manager.cc:1259] Loaded cluster ID: a83a8077a5e44743bda62555d83a765c
I20260808 08:53:07.991642 14375 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: loading cluster ID for follower catalog manager: success
I20260808 08:53:07.994207 14375 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: acquiring CA information for follower catalog manager: success
I20260808 08:53:07.995874 14375 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72bf44330e4b40c6baa5c6313c49dc54: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:53:08.340126 14460 catalog_manager.cc:1259] Loaded cluster ID: a83a8077a5e44743bda62555d83a765c
I20260808 08:53:08.340279 14460 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: loading cluster ID for follower catalog manager: success
I20260808 08:53:08.343266 14460 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: acquiring CA information for follower catalog manager: success
I20260808 08:53:08.345108 14460 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 603a4d63a19d4e878543233bb32d4923: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:53:08.496652 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:08.489305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.8.149.125:36139)
0808 08:53:08.490220 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:08.490225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:08.490243 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:53:08.490332 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:08.490335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:08.490499 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:08.490611 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:08.491237 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.492252 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.494228 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.494643 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.494737 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:08.495339 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:08.495902 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:08.496013 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:08.496246 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 08:53:08.496312 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":628,"threads_started":1}
I20260808 08:53:08.508787 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:08.503125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38534 (local address 127.8.149.124:41443)
0808 08:53:08.503743 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:08.503751 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:08.503772 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:53:08.503885 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:08.503889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:08.504033 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:08.504262 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:08.504654 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.505333 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.506696 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.507120 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.507260 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:08.507720 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:08.508252 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:08.508386 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:08.508462 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 08:53:08.508535 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":378,"threads_started":1}
I20260808 08:53:08.531251 14589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:08.514393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.8.149.126:40275)
0808 08:53:08.515475 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:08.515484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:08.515506 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:53:08.515629 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:08.515636 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:08.515848 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:08.516818 (+ 970us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:08.517067 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.518567 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.521298 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.522094 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.522850 (+ 756us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:08.523084 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:08.523537 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:08.530813 (+ 7276us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:08.530858 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 08:53:08.530954 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":921,"thread_start_us":812,"threads_started":1}
I20260808 08:53:08.531433 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:08.514227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42642 (local address 127.8.149.125:36139)
0808 08:53:08.514708 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:08.514714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:08.524243 (+ 9529us) server_negotiation.cc:407] Connection header received
0808 08:53:08.524510 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:08.524518 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:08.524623 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:08.524694 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:08.525541 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.526971 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.529095 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.529817 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.529920 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:08.530747 (+ 827us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:08.530876 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:08.530949 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:08.531128 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:53:08.531192 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353}
I20260808 08:53:08.534880 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:53:08.515115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38540 (local address 127.8.149.124:41443)
0808 08:53:08.515269 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 08:53:08.515286 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:53:08.527230 (+ 11944us) server_negotiation.cc:407] Connection header received
0808 08:53:08.527850 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:53:08.527856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:53:08.527952 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:53:08.528045 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:53:08.528910 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.530011 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.532830 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:53:08.533435 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:53:08.533545 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:53:08.534111 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:53:08.534302 (+ 191us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:53:08.534404 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:53:08.534549 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 08:53:08.534623 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:53:08.535755 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 13972
I20260808 08:53:08.536852 14088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:08.676472 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 13972
W20260808 08:53:08.703413 14134 connection.cc:535] server connection from 127.0.0.1:42516 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:53:08.703899 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14105
I20260808 08:53:08.705109 14209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:08.812850 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14105
I20260808 08:53:08.841116 8789 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu pid 14236
I20260808 08:53:08.842243 14337 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:53:08.946501 8789 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4pJ3L_/build/asan/bin/kudu with pid 14236
2026-08-08T08:53:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5143 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10239 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (375095 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST